[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:53 dist-test-slave-z8x9 krb5kdc[12595](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:53 dist-test-slave-z8x9 krb5kdc[12595](info): set up 2 sockets
Aug 08 14:55:53 dist-test-slave-z8x9 krb5kdc[12595](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 14:55:54.254653 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.004s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:55:54 dist-test-slave-z8x9 krb5kdc[12595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:55:54.439209 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:38213
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:36029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:38213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:54.776803 12625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:54.777158 12625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:54.777382 12625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:54.784852 12625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:54.785001 12625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:54.785107 12625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:54.785233 12625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:54.785322 12625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:54.795302 12625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:36029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:38213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:38213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:54.796639 12625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:54.798086 12625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:54.810513 12640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:54.810475 12643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:54.810568 12641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:54.811331 12625 server_base.cc:1034] running on GCE node
I20260808 14:55:54.812077 12625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:54.813488 12625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:54.814705 12625 hybrid_clock.cc:648] HybridClock initialized: now 1786200954814684 us; error 57 us; skew 500 ppm
I20260808 14:55:54.815008 12625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:54 dist-test-slave-z8x9 krb5kdc[12595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200954, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:54.818578 12625 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:55:54.820055 12625 webserver.cc:460] Webserver started at http://127.12.73.190:46299/ using document root <none> and password file <none>
I20260808 14:55:54.820752 12625 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:54.820889 12625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:54.821288 12625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:54.824316 12625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "b3854865ef1049b087cbeb44e3ef433b"
format_stamp: "Formatted at 2026-08-08 14:55:54 on dist-test-slave-z8x9"
server_key: "da0bc3e2f6889ec3a7798840d6c0034e"
server_key_iv: "0aebdb1a03ead31a35f75387456f3c40"
server_key_version: "encryptionkey@0"
I20260808 14:55:54.825098 12625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "b3854865ef1049b087cbeb44e3ef433b"
format_stamp: "Formatted at 2026-08-08 14:55:54 on dist-test-slave-z8x9"
server_key: "da0bc3e2f6889ec3a7798840d6c0034e"
server_key_iv: "0aebdb1a03ead31a35f75387456f3c40"
server_key_version: "encryptionkey@0"
I20260808 14:55:54.830228 12625 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.003s
I20260808 14:55:54.833603 12658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:54.834797 12625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:55:54.834975 12625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "b3854865ef1049b087cbeb44e3ef433b"
format_stamp: "Formatted at 2026-08-08 14:55:54 on dist-test-slave-z8x9"
server_key: "da0bc3e2f6889ec3a7798840d6c0034e"
server_key_iv: "0aebdb1a03ead31a35f75387456f3c40"
server_key_version: "encryptionkey@0"
I20260808 14:55:54.835165 12625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:54.852044 12625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:54.856527 12625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:54.856832 12625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:54.875737 12625 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:38213
I20260808 14:55:54.875756 12742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:38213 every 8 connection(s)
I20260808 14:55:54.877323 12625 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:54.881022 12744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:54.887121 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 12625
I20260808 14:55:54.887496 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:55:54.889997 12582 external_mini_cluster.cc:1428] Setting key f021e9c8dca2b4e98d53a26afcea2964
I20260808 14:55:54.893186 12744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b: Bootstrap starting.
I20260808 14:55:54.897332 12744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:54.898692 12744 log.cc:824] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:54.902098 12744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b: No bootstrap required, opened a new log
I20260808 14:55:54.912142 12744 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3854865ef1049b087cbeb44e3ef433b" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38213 } }
I20260808 14:55:54.912609 12744 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:54.912727 12744 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3854865ef1049b087cbeb44e3ef433b, State: Initialized, Role: FOLLOWER
I20260808 14:55:54.913477 12744 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3854865ef1049b087cbeb44e3ef433b" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38213 } }
I20260808 14:55:54.913764 12744 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:54.913911 12744 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:54.914103 12744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:54.917075 12744 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3854865ef1049b087cbeb44e3ef433b" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38213 } }
I20260808 14:55:54.917850 12744 leader_election.cc:302] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3854865ef1049b087cbeb44e3ef433b; no voters:
I20260808 14:55:54.918537 12744 leader_election.cc:288] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:54.918656 12750 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:54.920142 12750 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [term 1 LEADER]: Becoming Leader. State: Replica: b3854865ef1049b087cbeb44e3ef433b, State: Running, Role: LEADER
I20260808 14:55:54.920825 12744 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:54.920966 12750 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3854865ef1049b087cbeb44e3ef433b" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38213 } }
I20260808 14:55:54.924449 12754 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3854865ef1049b087cbeb44e3ef433b. Latest consensus state: current_term: 1 leader_uuid: "b3854865ef1049b087cbeb44e3ef433b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3854865ef1049b087cbeb44e3ef433b" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38213 } } }
I20260808 14:55:54.924844 12754 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:54.925488 12751 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3854865ef1049b087cbeb44e3ef433b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3854865ef1049b087cbeb44e3ef433b" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38213 } } }
I20260808 14:55:54.925875 12751 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b [sys.catalog]: This master's current role is: LEADER
Aug 08 14:55:54 dist-test-slave-z8x9 krb5kdc[12595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:55:54.930434 12761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:54.938678 12761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:54.946470 12747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:54.894771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37664 (local address 127.12.73.190:38213)
0808 14:55:54.895790 (+ 1019us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:54.895805 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:54.897046 (+ 1241us) server_negotiation.cc:407] Connection header received
0808 14:55:54.911665 (+ 14619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:54.911687 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:54.912053 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:54.912368 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:54.916420 (+ 4052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:54.918236 (+ 1816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:54.920844 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:54.922078 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:54.922292 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:54.934001 (+ 11709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:54.934051 (+ 50us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:54.934081 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:54.934233 (+ 152us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:54.939464 (+ 5231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:54.940679 (+ 1215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:54.940692 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:54.940702 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:54.940977 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:54.941702 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:54.941708 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:54.941711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:54.942592 (+ 881us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:54.943018 (+ 426us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:54.944474 (+ 1456us) server_negotiation.cc:299] Negotiation successful
0808 14:55:54.944944 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":719,"thread_start_us":414,"threads_started":1}
I20260808 14:55:54.953469 12761 catalog_manager.cc:1347] Generated new cluster ID: 1893905572c2430f909992c019aaf96a
I20260808 14:55:54.953579 12761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:54.992602 12761 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:54.994087 12761 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:55.010106 12761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3854865ef1049b087cbeb44e3ef433b: Generated new TSK 0
I20260808 14:55:55.010938 12761 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:55:55.065261 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:38213
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:36029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:55.402921 12796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:55.403254 12796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:55.403455 12796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:55.410550 12796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:55.410734 12796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:55.410934 12796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:55:55.420457 12796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:36029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:38213
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:55.421837 12796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:55.423175 12796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:55.443527 12806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:55.443629 12807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:55.443574 12809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:55.445410 12796 server_base.cc:1034] running on GCE node
I20260808 14:55:55.446071 12796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:55.447252 12796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:55.448458 12796 hybrid_clock.cc:648] HybridClock initialized: now 1786200955448392 us; error 61 us; skew 500 ppm
I20260808 14:55:55.448778 12796 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:55 dist-test-slave-z8x9 krb5kdc[12595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200955, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:55.452344 12796 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:55:55.453912 12796 webserver.cc:460] Webserver started at http://127.12.73.129:36231/ using document root <none> and password file <none>
I20260808 14:55:55.454645 12796 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:55.454784 12796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:55.455132 12796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:55.458254 12796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "0b4c33f4a65c4c6fb6bca1a79e85dbca"
format_stamp: "Formatted at 2026-08-08 14:55:55 on dist-test-slave-z8x9"
server_key: "7df88ea043d3528cf898f3dc93d2f618"
server_key_iv: "84f6fc399347877ad8cbc2d3bfafa9b6"
server_key_version: "encryptionkey@0"
I20260808 14:55:55.459040 12796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "0b4c33f4a65c4c6fb6bca1a79e85dbca"
format_stamp: "Formatted at 2026-08-08 14:55:55 on dist-test-slave-z8x9"
server_key: "7df88ea043d3528cf898f3dc93d2f618"
server_key_iv: "84f6fc399347877ad8cbc2d3bfafa9b6"
server_key_version: "encryptionkey@0"
I20260808 14:55:55.464661 12796 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:55:55.468322 12825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:55.469641 12796 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:55:55.469826 12796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "0b4c33f4a65c4c6fb6bca1a79e85dbca"
format_stamp: "Formatted at 2026-08-08 14:55:55 on dist-test-slave-z8x9"
server_key: "7df88ea043d3528cf898f3dc93d2f618"
server_key_iv: "84f6fc399347877ad8cbc2d3bfafa9b6"
server_key_version: "encryptionkey@0"
I20260808 14:55:55.470021 12796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:55.497721 12796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:55.501837 12796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:55.502144 12796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:55.503131 12796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:55:55.504498 12796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:55:55.504575 12796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:55.504738 12796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:55:55.504828 12796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:55.541620 12796 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:46299
I20260808 14:55:55.541682 13034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:46299 every 8 connection(s)
I20260808 14:55:55.542995 12796 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:55:55.547304 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 12796
I20260808 14:55:55.547562 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:55:55.548419 12582 external_mini_cluster.cc:1428] Setting key 57d2a48a69f978a6d2b2d9f6b9f8dc32
Aug 08 14:55:55 dist-test-slave-z8x9 krb5kdc[12595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200955, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:55:55.567219 13039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:55.545902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:53383 (local address 127.12.73.190:38213)
0808 14:55:55.546354 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:55.546359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:55.549128 (+ 2769us) server_negotiation.cc:407] Connection header received
0808 14:55:55.550040 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:55.550044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:55.550111 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:55.550197 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:55.552259 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:55.552972 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:55.555547 (+ 2575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:55.555946 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:55.556042 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:55.559956 (+ 3914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:55.559966 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:55.559973 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:55.560018 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:55.563765 (+ 3747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:55.564501 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:55.564510 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:55.564517 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:55.564675 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:55.565213 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:55.565221 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:55.565226 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:55.565661 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:55.565838 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:55.566510 (+ 672us) server_negotiation.cc:299] Negotiation successful
0808 14:55:55.566781 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":247,"threads_started":1}
I20260808 14:55:55.567821 13040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:55.546398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:38213 (local address 127.12.73.129:53383)
0808 14:55:55.547246 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:55.547310 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:55.549738 (+ 2428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:55.550464 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:55.550471 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:55.551220 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:55.552065 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:55.552095 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:55.553139 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:55.553147 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:55.555398 (+ 2251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:55.555422 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:55.556174 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:55.556183 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:55.556514 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:55.557373 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:55.557395 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:55.559732 (+ 2337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:55.563919 (+ 4187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:55.563926 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:55.563937 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:55.564358 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:55.564814 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:55.564821 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:55.564825 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:55.565057 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:55.565790 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:55.565796 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:55.566105 (+ 309us) client_negotiation.cc:769] Sending connection context
0808 14:55:55.566326 (+ 221us) client_negotiation.cc:240] Negotiation successful
0808 14:55:55.566716 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":308,"threads_started":1}
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
I20260808 14:55:55.569450 13036 heartbeater.cc:347] Connected to a master server at 127.12.73.190:38213
I20260808 14:55:55.569748 13036 heartbeater.cc:464] Registering TS with master...
I20260808 14:55:55.570540 13036 heartbeater.cc:511] Master 127.12.73.190:38213 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
I20260808 14:55:55.572817 12692 ts_manager.cc:194] Registered new tserver with Master: 0b4c33f4a65c4c6fb6bca1a79e85dbca (127.12.73.129:46299)
I20260808 14:55:55.575222 12692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:53383
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:55:55.594435 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:38213
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:36029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:55.933952 13043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:55.934290 13043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:55.934499 13043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:55.943310 13043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:55.943490 13043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:55.943676 13043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:55:55.953845 13043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:36029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:38213
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:55.955153 13043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:55.956527 13043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:55.970142 13052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:55.970134 13053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:55.970189 13056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:55.971334 13043 server_base.cc:1034] running on GCE node
I20260808 14:55:55.972010 13043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:55.972906 13043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:55.974103 13043 hybrid_clock.cc:648] HybridClock initialized: now 1786200955974018 us; error 85 us; skew 500 ppm
I20260808 14:55:55.974381 13043 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:55 dist-test-slave-z8x9 krb5kdc[12595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200955, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:55.977725 13043 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:55:55.979172 13043 webserver.cc:460] Webserver started at http://127.12.73.130:45001/ using document root <none> and password file <none>
I20260808 14:55:55.979854 13043 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:55.979983 13043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:55.980309 13043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:55.983234 13043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "a2743c245864445d9e1b0e3193d7100b"
format_stamp: "Formatted at 2026-08-08 14:55:55 on dist-test-slave-z8x9"
server_key: "34b8ebdd606342b912a4920e67ec177c"
server_key_iv: "ddf94b122104c7bd1ffbb667971e35d1"
server_key_version: "encryptionkey@0"
I20260808 14:55:55.984002 13043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "a2743c245864445d9e1b0e3193d7100b"
format_stamp: "Formatted at 2026-08-08 14:55:55 on dist-test-slave-z8x9"
server_key: "34b8ebdd606342b912a4920e67ec177c"
server_key_iv: "ddf94b122104c7bd1ffbb667971e35d1"
server_key_version: "encryptionkey@0"
I20260808 14:55:55.989079 13043 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:55:55.992663 13065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:55.994068 13043 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:55:55.994259 13043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "a2743c245864445d9e1b0e3193d7100b"
format_stamp: "Formatted at 2026-08-08 14:55:55 on dist-test-slave-z8x9"
server_key: "34b8ebdd606342b912a4920e67ec177c"
server_key_iv: "ddf94b122104c7bd1ffbb667971e35d1"
server_key_version: "encryptionkey@0"
I20260808 14:55:55.994472 13043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:56.018302 13043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:56.022882 13043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:56.023188 13043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:56.024184 13043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:55:56.025566 13043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:55:56.025693 13043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:56.025849 13043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:55:56.025925 13043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:56.061383 13043 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:32829
I20260808 14:55:56.061426 13287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:32829 every 8 connection(s)
I20260808 14:55:56.062691 13043 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:55:56.072038 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 13043
I20260808 14:55:56.072263 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:55:56.072734 12582 external_mini_cluster.cc:1428] Setting key 1e92c1f74a496893388eb8244dc63d56
Aug 08 14:55:56 dist-test-slave-z8x9 krb5kdc[12595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200955, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:55:56.085151 13039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:56.065422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:43347 (local address 127.12.73.190:38213)
0808 14:55:56.065644 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:56.065649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:56.066862 (+ 1213us) server_negotiation.cc:407] Connection header received
0808 14:55:56.069414 (+ 2552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:56.069420 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:56.069518 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:56.069634 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:56.071330 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.072043 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.074093 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.074658 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.074767 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:56.078520 (+ 3753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:56.078529 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:56.078537 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:56.078585 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:56.081723 (+ 3138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.082731 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.082736 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.082738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.082870 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.083375 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.083378 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.083380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.083655 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:56.083781 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:56.084717 (+ 936us) server_negotiation.cc:299] Negotiation successful
0808 14:55:56.084900 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:55:56.086794 13293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:56.065950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:38213 (local address 127.12.73.130:43347)
0808 14:55:56.066677 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:56.066733 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:56.068978 (+ 2245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:56.069879 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:56.069887 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:56.070532 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:56.071129 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:56.071156 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.072218 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.072223 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:56.073928 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:56.073946 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.074901 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.074910 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:56.075165 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:56.075891 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:56.075920 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:56.078276 (+ 2356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:56.081881 (+ 3605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:56.081894 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:56.081915 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:56.082584 (+ 669us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:56.082982 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:56.082989 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:56.082996 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:56.083252 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:56.083800 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:56.083811 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:56.084291 (+ 480us) client_negotiation.cc:769] Sending connection context
0808 14:55:56.084606 (+ 315us) client_negotiation.cc:240] Negotiation successful
0808 14:55:56.085243 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":295,"threads_started":1}
I20260808 14:55:56.088357 13288 heartbeater.cc:347] Connected to a master server at 127.12.73.190:38213
I20260808 14:55:56.088682 13288 heartbeater.cc:464] Registering TS with master...
I20260808 14:55:56.089498 13288 heartbeater.cc:511] Master 127.12.73.190:38213 requested a full tablet report, sending...
I20260808 14:55:56.091033 12692 ts_manager.cc:194] Registered new tserver with Master: a2743c245864445d9e1b0e3193d7100b (127.12.73.130:32829)
I20260808 14:55:56.091858 12692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:43347
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:55:56.118610 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:38213
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:36029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:56.452494 13298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:56.452768 13298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:56.452936 13298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:56.460213 13298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:56.460315 13298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:56.460510 13298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:55:56.470124 13298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:36029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:38213
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:56.471326 13298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:56.472649 13298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:56.486089 13309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:56.486304 13308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:56.486270 13312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:56.487236 13298 server_base.cc:1034] running on GCE node
I20260808 14:55:56.487819 13298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:56.488713 13298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:56.489944 13298 hybrid_clock.cc:648] HybridClock initialized: now 1786200956489898 us; error 54 us; skew 500 ppm
I20260808 14:55:56.490281 13298 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:56 dist-test-slave-z8x9 krb5kdc[12595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200956, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:56.493615 13298 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:55:56.494938 13298 webserver.cc:460] Webserver started at http://127.12.73.131:33383/ using document root <none> and password file <none>
I20260808 14:55:56.495554 13298 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:56.495656 13298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:56.495920 13298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:56.498950 13298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "48a4dfcf63d1487990a18b0ea38e7886"
format_stamp: "Formatted at 2026-08-08 14:55:56 on dist-test-slave-z8x9"
server_key: "f4530b376066f5980792b99c28ff91f6"
server_key_iv: "8fa2205d036c0791228b0c713186ecf9"
server_key_version: "encryptionkey@0"
I20260808 14:55:56.499778 13298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "48a4dfcf63d1487990a18b0ea38e7886"
format_stamp: "Formatted at 2026-08-08 14:55:56 on dist-test-slave-z8x9"
server_key: "f4530b376066f5980792b99c28ff91f6"
server_key_iv: "8fa2205d036c0791228b0c713186ecf9"
server_key_version: "encryptionkey@0"
I20260808 14:55:56.504731 13298 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 14:55:56.508029 13326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:56.509352 13298 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 14:55:56.509480 13298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "48a4dfcf63d1487990a18b0ea38e7886"
format_stamp: "Formatted at 2026-08-08 14:55:56 on dist-test-slave-z8x9"
server_key: "f4530b376066f5980792b99c28ff91f6"
server_key_iv: "8fa2205d036c0791228b0c713186ecf9"
server_key_version: "encryptionkey@0"
I20260808 14:55:56.509634 13298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:56.520939 13298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:56.524849 13298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:56.525092 13298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:56.525996 13298 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:55:56.527227 13298 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:55:56.527307 13298 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:56.527390 13298 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:55:56.527433 13298 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
W20260808 14:55:56.546430 13026 messenger.cc:188] Invalid argument: socket address is ambiguous: no data on pending connections for acceptor pool at 127.12.73.129:46299
I20260808 14:55:56.562850 13298 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:42135
I20260808 14:55:56.562896 13548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:42135 every 8 connection(s)
I20260808 14:55:56.564146 13298 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:55:56.566576 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 13298
I20260808 14:55:56.566795 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:55:56.567343 12582 external_mini_cluster.cc:1428] Setting key de79211d4a4cdfb22db893b602d5bbdc
Aug 08 14:55:56 dist-test-slave-z8x9 krb5kdc[12595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200956, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:55:56.578294 13036 heartbeater.cc:503] Master 127.12.73.190:38213 was elected leader, sending a full tablet report...
I20260808 14:55:56.584862 13039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:56.566858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:45663 (local address 127.12.73.190:38213)
0808 14:55:56.567065 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:56.567070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:56.568419 (+ 1349us) server_negotiation.cc:407] Connection header received
0808 14:55:56.570521 (+ 2102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:56.570526 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:56.570615 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:56.570769 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:56.572227 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.572996 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.574696 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.575122 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.575257 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:56.578895 (+ 3638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:56.578900 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:56.578904 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:56.578935 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:56.581938 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.582803 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.582812 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.582816 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.582963 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.583452 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.583455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.583457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.583703 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:56.583811 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:56.584452 (+ 641us) server_negotiation.cc:299] Negotiation successful
0808 14:55:56.584604 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:55:56.585942 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:56.567450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:38213 (local address 127.12.73.131:45663)
0808 14:55:56.568214 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:56.568279 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:56.570275 (+ 1996us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:56.570992 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:56.570999 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:56.571517 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:56.572061 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:56.572078 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.573163 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.573219 (+ 56us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:56.574551 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:56.574563 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.575368 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.575375 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:56.575605 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:56.576231 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:56.576269 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:56.578694 (+ 2425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:56.582063 (+ 3369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:56.582072 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:56.582089 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:56.582683 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:56.583091 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:56.583096 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:56.583099 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:56.583345 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:56.583813 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:56.583819 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:56.584103 (+ 284us) client_negotiation.cc:769] Sending connection context
0808 14:55:56.584368 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 14:55:56.584848 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":328,"threads_started":1}
I20260808 14:55:56.587229 13551 heartbeater.cc:347] Connected to a master server at 127.12.73.190:38213
I20260808 14:55:56.587536 13551 heartbeater.cc:464] Registering TS with master...
I20260808 14:55:56.588227 13551 heartbeater.cc:511] Master 127.12.73.190:38213 requested a full tablet report, sending...
I20260808 14:55:56.589624 12692 ts_manager.cc:194] Registered new tserver with Master: 48a4dfcf63d1487990a18b0ea38e7886 (127.12.73.131:42135)
I20260808 14:55:56.590410 12692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:45663
I20260808 14:55:56.595194 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:55:56 dist-test-slave-z8x9 krb5kdc[12595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200956, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:55:56 dist-test-slave-z8x9 krb5kdc[12595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200956, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:55:56.642925 13564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:56.628017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55792 (local address 127.12.73.129:46299)
0808 14:55:56.628655 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:56.628662 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:56.628712 (+ 50us) server_negotiation.cc:407] Connection header received
0808 14:55:56.628869 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:56.628876 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:56.629100 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:56.629315 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:56.630716 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.631774 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.632994 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.633615 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.633714 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:56.637566 (+ 3852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:56.637577 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:56.637590 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:56.637621 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:56.640527 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.641116 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.641123 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.641125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.641324 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.641669 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.641672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.641674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.641995 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:56.642211 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:56.642453 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 14:55:56.642638 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":310,"threads_started":1}
W20260808 14:55:56.644129 12877 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55792
Aug 08 14:55:56 dist-test-slave-z8x9 krb5kdc[12595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:55:56 dist-test-slave-z8x9 krb5kdc[12595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:55:56.692472 13564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:56.678916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55802 (local address 127.12.73.129:46299)
0808 14:55:56.679159 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:56.679164 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:56.679287 (+ 123us) server_negotiation.cc:407] Connection header received
0808 14:55:56.679441 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:56.679445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:56.679541 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:56.679627 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:56.681275 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.681972 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.683242 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.683600 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.683684 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:56.687743 (+ 4059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:56.687748 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:56.687751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:56.687782 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:56.690278 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.690866 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.690870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.690872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.690987 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.691293 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.691296 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.691298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.691521 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:56.691693 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:56.691991 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 14:55:56.692147 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 14:55:56.694042 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 12796
I20260808 14:55:56.706193 13564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:56.695063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55812 (local address 127.12.73.129:46299)
0808 14:55:56.695259 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:56.695263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:56.695533 (+ 270us) server_negotiation.cc:407] Connection header received
0808 14:55:56.695634 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:56.695637 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:56.695685 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:56.695756 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:56.696847 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.697621 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.698935 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.699341 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.699440 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:56.701673 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:56.701677 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:56.701680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:56.701705 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:56.703984 (+ 2279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.704556 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.704559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.704562 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.704683 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.704972 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.704975 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.704977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.705252 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:56.705459 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:56.705770 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 14:55:56.705923 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:55:56.706904 13025 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:56.790369 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 12796
I20260808 14:55:56.816282 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 13043
Aug 08 14:55:56 dist-test-slave-z8x9 krb5kdc[12595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:55:56.832558 13577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:56.817253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51528 (local address 127.12.73.130:32829)
0808 14:55:56.817788 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:56.817795 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:56.817820 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:55:56.817879 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:56.817885 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:56.818081 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:56.818256 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:56.819502 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.820480 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.821919 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.822537 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.822683 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:56.826771 (+ 4088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:56.826782 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:56.826796 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:56.826840 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:56.829585 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.830273 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.830280 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.830283 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.830421 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.830855 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.830860 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.830862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.831266 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:56.831589 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:56.831912 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 14:55:56.832190 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":259,"threads_started":1}
I20260808 14:55:56.833844 13281 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:56.918157 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 13043
I20260808 14:55:56.943696 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 13298
Aug 08 14:55:56 dist-test-slave-z8x9 krb5kdc[12595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:55:56.960453 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:56.944774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60042 (local address 127.12.73.131:42135)
0808 14:55:56.945551 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:56.945558 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:56.945587 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:55:56.945647 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:56.945653 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:56.945874 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:56.946044 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:56.947493 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.948507 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.949952 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:56.950499 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:56.950646 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:56.954857 (+ 4211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:56.954868 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:56.954882 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:56.954914 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:56.957634 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.958304 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.958311 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.958313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.958433 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:56.958813 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:56.958819 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:56.958822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:56.959167 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:56.959504 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:56.959815 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 14:55:56.960113 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":334,"threads_started":1}
I20260808 14:55:56.961815 13535 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:57.046286 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 13298
I20260808 14:55:57.069139 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 12625
I20260808 14:55:57.070459 12737 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:57.173436 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 12625
2026-08-08T14:55:57Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4261 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:57 dist-test-slave-z8x9 krb5kdc[13600](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:57 dist-test-slave-z8x9 krb5kdc[13600](info): set up 2 sockets
Aug 08 14:55:57 dist-test-slave-z8x9 krb5kdc[13600](info): commencing operation
krb5kdc: starting...
W20260808 14:55:58.511973 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.008s sys 0.012s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:55:58 dist-test-slave-z8x9 krb5kdc[13600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:55:58.706291 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33363
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:33363
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:59.025055 13625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:59.025355 13625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:59.025542 13625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:59.032572 13625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:59.032672 13625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:59.032775 13625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:59.032883 13625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:59.032950 13625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:59.042521 13625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:33363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:59.043829 13625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:59.045110 13625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:59.057134 13646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:59.057292 13640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:59.057463 13642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:59.057943 13625 server_base.cc:1034] running on GCE node
I20260808 14:55:59.058774 13625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:59.060105 13625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:59.061273 13625 hybrid_clock.cc:648] HybridClock initialized: now 1786200959061230 us; error 31 us; skew 500 ppm
I20260808 14:55:59.061630 13625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:59 dist-test-slave-z8x9 krb5kdc[13600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200959, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:59.068565 13625 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:55:59.070051 13625 webserver.cc:460] Webserver started at http://127.12.73.190:39227/ using document root <none> and password file <none>
I20260808 14:55:59.070679 13625 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:59.070791 13625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:59.071049 13625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:59.074064 13625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "ebae9b13d8294e4da7e8afd6a5b53a68"
format_stamp: "Formatted at 2026-08-08 14:55:59 on dist-test-slave-z8x9"
server_key: "b153e9b6c41293d0a368fbfed01932dd"
server_key_iv: "2c4cda5560081e50e0a694f855c83821"
server_key_version: "encryptionkey@0"
I20260808 14:55:59.074774 13625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "ebae9b13d8294e4da7e8afd6a5b53a68"
format_stamp: "Formatted at 2026-08-08 14:55:59 on dist-test-slave-z8x9"
server_key: "b153e9b6c41293d0a368fbfed01932dd"
server_key_iv: "2c4cda5560081e50e0a694f855c83821"
server_key_version: "encryptionkey@0"
I20260808 14:55:59.079663 13625 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:55:59.082911 13656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:59.084175 13625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:55:59.084371 13625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "ebae9b13d8294e4da7e8afd6a5b53a68"
format_stamp: "Formatted at 2026-08-08 14:55:59 on dist-test-slave-z8x9"
server_key: "b153e9b6c41293d0a368fbfed01932dd"
server_key_iv: "2c4cda5560081e50e0a694f855c83821"
server_key_version: "encryptionkey@0"
I20260808 14:55:59.084571 13625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:59.097059 13625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:59.100891 13625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:59.101258 13625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:59.119757 13625 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:33363
I20260808 14:55:59.119786 13755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:33363 every 8 connection(s)
I20260808 14:55:59.121117 13625 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:59.123046 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 13625
I20260808 14:55:59.123304 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:55:59.124007 12582 external_mini_cluster.cc:1428] Setting key 9b79c39cee38b9fa8942d1d4fa3318f7
I20260808 14:55:59.124989 13756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 14:55:59 dist-test-slave-z8x9 krb5kdc[13600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:55:59.138649 13756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68: Bootstrap starting.
I20260808 14:55:59.142665 13756 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:59.143980 13756 log.cc:824] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:59.147495 13756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68: No bootstrap required, opened a new log
I20260808 14:55:59.148813 13759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:59.126011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46132 (local address 127.12.73.190:33363)
0808 14:55:59.126862 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:59.126879 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:59.126928 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:55:59.128618 (+ 1690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:59.128644 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:59.129127 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:59.129565 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:59.130892 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:59.132927 (+ 2035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:59.134456 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:59.135516 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:59.135718 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:59.139707 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:59.139719 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:59.139738 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:59.139787 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:59.144126 (+ 4339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:59.145002 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:59.145008 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:59.145013 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:59.145300 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:59.145713 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:59.145718 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:59.145721 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:59.146415 (+ 694us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:59.146756 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:59.147137 (+ 381us) server_negotiation.cc:299] Negotiation successful
0808 14:55:59.147563 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":361,"threads_started":1}
I20260808 14:55:59.155493 13756 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebae9b13d8294e4da7e8afd6a5b53a68" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33363 } }
I20260808 14:55:59.155853 13756 raft_consensus.cc:374] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:59.155944 13756 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebae9b13d8294e4da7e8afd6a5b53a68, State: Initialized, Role: FOLLOWER
I20260808 14:55:59.156387 13756 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebae9b13d8294e4da7e8afd6a5b53a68" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33363 } }
I20260808 14:55:59.156569 13756 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:59.156667 13756 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:59.156782 13756 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:59.159180 13756 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebae9b13d8294e4da7e8afd6a5b53a68" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33363 } }
I20260808 14:55:59.159582 13756 leader_election.cc:302] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebae9b13d8294e4da7e8afd6a5b53a68; no voters:
I20260808 14:55:59.160095 13756 leader_election.cc:288] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:59.160266 13767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:59.161012 13767 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [term 1 LEADER]: Becoming Leader. State: Replica: ebae9b13d8294e4da7e8afd6a5b53a68, State: Running, Role: LEADER
I20260808 14:55:59.161651 13767 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebae9b13d8294e4da7e8afd6a5b53a68" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33363 } }
I20260808 14:55:59.162323 13756 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:59.164893 13773 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebae9b13d8294e4da7e8afd6a5b53a68. Latest consensus state: current_term: 1 leader_uuid: "ebae9b13d8294e4da7e8afd6a5b53a68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebae9b13d8294e4da7e8afd6a5b53a68" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33363 } } }
I20260808 14:55:59.165357 13773 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:59.165910 13772 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ebae9b13d8294e4da7e8afd6a5b53a68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebae9b13d8294e4da7e8afd6a5b53a68" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33363 } } }
I20260808 14:55:59.166283 13772 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:59.170121 13780 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:59.174139 13780 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:59.182700 13780 catalog_manager.cc:1347] Generated new cluster ID: db8dfa22c5154c2eaa39f5e27a74a022
I20260808 14:55:59.182817 13780 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:59.201103 13780 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:59.203012 13780 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:59.211447 13780 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ebae9b13d8294e4da7e8afd6a5b53a68: Generated new TSK 0
I20260808 14:55:59.212389 13780 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:55:59.261032 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33363
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:59.593855 13804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:59.594187 13804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:59.594374 13804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:59.601760 13804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:59.601913 13804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:59.602092 13804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:55:59.612040 13804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33363
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:59.613404 13804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:59.614735 13804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:59.627948 13813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:59.628015 13818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:59.627867 13814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:59.628742 13804 server_base.cc:1034] running on GCE node
I20260808 14:55:59.629419 13804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:59.630363 13804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:59.631590 13804 hybrid_clock.cc:648] HybridClock initialized: now 1786200959631547 us; error 36 us; skew 500 ppm
I20260808 14:55:59.631942 13804 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:59 dist-test-slave-z8x9 krb5kdc[13600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200959, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:59.635149 13804 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:55:59.636598 13804 webserver.cc:460] Webserver started at http://127.12.73.129:39093/ using document root <none> and password file <none>
I20260808 14:55:59.637326 13804 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:59.637503 13804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:59.637818 13804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:59.640569 13804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "bcfd44330d7d4ff1979da54588b496bc"
format_stamp: "Formatted at 2026-08-08 14:55:59 on dist-test-slave-z8x9"
server_key: "c128489c13832f59c40a91a7a80dad46"
server_key_iv: "6552c9731efb168d3a38525cbbc078f3"
server_key_version: "encryptionkey@0"
I20260808 14:55:59.641398 13804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "bcfd44330d7d4ff1979da54588b496bc"
format_stamp: "Formatted at 2026-08-08 14:55:59 on dist-test-slave-z8x9"
server_key: "c128489c13832f59c40a91a7a80dad46"
server_key_iv: "6552c9731efb168d3a38525cbbc078f3"
server_key_version: "encryptionkey@0"
I20260808 14:55:59.646401 13804 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:55:59.650260 13832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:59.651624 13804 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:55:59.651810 13804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "bcfd44330d7d4ff1979da54588b496bc"
format_stamp: "Formatted at 2026-08-08 14:55:59 on dist-test-slave-z8x9"
server_key: "c128489c13832f59c40a91a7a80dad46"
server_key_iv: "6552c9731efb168d3a38525cbbc078f3"
server_key_version: "encryptionkey@0"
I20260808 14:55:59.652019 13804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:59.689508 13804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:59.694147 13804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:59.694489 13804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:59.695535 13804 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:55:59.697026 13804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:55:59.697201 13804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:59.697393 13804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:55:59.697479 13804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:59.735008 13804 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:35035
I20260808 14:55:59.735040 14044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:35035 every 8 connection(s)
I20260808 14:55:59.736438 13804 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:55:59.743906 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 13804
I20260808 14:55:59.744160 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:55:59.744789 12582 external_mini_cluster.cc:1428] Setting key eb0262b639a90573ee20bb8d8227876c
Aug 08 14:55:59 dist-test-slave-z8x9 krb5kdc[13600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200959, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:55:59.758067 14050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:59.739152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:33949 (local address 127.12.73.190:33363)
0808 14:55:59.739680 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:59.739685 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:59.740524 (+ 839us) server_negotiation.cc:407] Connection header received
0808 14:55:59.742673 (+ 2149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:59.742679 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:59.742774 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:59.742903 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:59.744622 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:59.745668 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:59.747422 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:59.747882 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:59.748033 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:59.751898 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:59.751903 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:59.751906 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:59.751937 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:59.754856 (+ 2919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:59.755678 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:59.755684 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:59.755690 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:59.755813 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:59.756256 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:59.756262 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:59.756265 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:59.756581 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:59.756736 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:59.757462 (+ 726us) server_negotiation.cc:299] Negotiation successful
0808 14:55:59.757685 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":280,"threads_started":1}
I20260808 14:55:59.759009 14052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:59.739609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33363 (local address 127.12.73.129:33949)
0808 14:55:59.740349 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:59.740390 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:59.742359 (+ 1969us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:59.743182 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:59.743190 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:59.743749 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:59.744438 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:59.744459 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:59.745842 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:59.745846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:59.747258 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:59.747271 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:59.748150 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:59.748160 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:59.748412 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:59.749311 (+ 899us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:59.749332 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:59.751669 (+ 2337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:59.754992 (+ 3323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:59.755001 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:59.755015 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:59.755548 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:59.755942 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:59.755947 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:59.755951 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:59.756141 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:59.756708 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:59.756715 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:59.757034 (+ 319us) client_negotiation.cc:769] Sending connection context
0808 14:55:59.757371 (+ 337us) client_negotiation.cc:240] Negotiation successful
0808 14:55:59.757883 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":317,"threads_started":1}
I20260808 14:55:59.760630 14046 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33363
I20260808 14:55:59.760933 14046 heartbeater.cc:464] Registering TS with master...
I20260808 14:55:59.761669 14046 heartbeater.cc:511] Master 127.12.73.190:33363 requested a full tablet report, sending...
I20260808 14:55:59.763824 13680 ts_manager.cc:194] Registered new tserver with Master: bcfd44330d7d4ff1979da54588b496bc (127.12.73.129:35035)
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
I20260808 14:55:59.765426 13680 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:33949
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:55:59.790519 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33363
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:00.148321 14055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:00.148635 14055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:00.148792 14055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:00.156414 14055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:00.156533 14055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:00.156752 14055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:56:00.167986 14055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33363
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:00.169539 14055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:00.171068 14055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:00.184862 14064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:00.184978 14066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:00.184983 14068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:00.186285 14055 server_base.cc:1034] running on GCE node
I20260808 14:56:00.186993 14055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:00.188078 14055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:00.189324 14055 hybrid_clock.cc:648] HybridClock initialized: now 1786200960189222 us; error 91 us; skew 500 ppm
I20260808 14:56:00.189706 14055 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:00 dist-test-slave-z8x9 krb5kdc[13600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200960, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:00.193400 14055 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:56:00.195045 14055 webserver.cc:460] Webserver started at http://127.12.73.130:39495/ using document root <none> and password file <none>
I20260808 14:56:00.195752 14055 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:00.195868 14055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:00.196163 14055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:00.199692 14055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "050a2d06eb254a779628691922134a95"
format_stamp: "Formatted at 2026-08-08 14:56:00 on dist-test-slave-z8x9"
server_key: "bc53a01d857dc7d7b58d6631f5178338"
server_key_iv: "8d510f8183770322875cc4a715c04d27"
server_key_version: "encryptionkey@0"
I20260808 14:56:00.200517 14055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "050a2d06eb254a779628691922134a95"
format_stamp: "Formatted at 2026-08-08 14:56:00 on dist-test-slave-z8x9"
server_key: "bc53a01d857dc7d7b58d6631f5178338"
server_key_iv: "8d510f8183770322875cc4a715c04d27"
server_key_version: "encryptionkey@0"
I20260808 14:56:00.206055 14055 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 14:56:00.209678 14080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:00.211024 14055 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 14:56:00.211238 14055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "050a2d06eb254a779628691922134a95"
format_stamp: "Formatted at 2026-08-08 14:56:00 on dist-test-slave-z8x9"
server_key: "bc53a01d857dc7d7b58d6631f5178338"
server_key_iv: "8d510f8183770322875cc4a715c04d27"
server_key_version: "encryptionkey@0"
I20260808 14:56:00.211464 14055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:00.276391 14055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:00.281656 14055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:00.282015 14055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:00.283090 14055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:00.284575 14055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:00.284694 14055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:00.284871 14055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:00.284965 14055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:00.321874 14055 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:39981
I20260808 14:56:00.321933 14288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:39981 every 8 connection(s)
I20260808 14:56:00.323258 14055 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:56:00.330809 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 14055
I20260808 14:56:00.331030 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:56:00.331492 12582 external_mini_cluster.cc:1428] Setting key 96798a37af57edfd9fa74c1bdf3da912
Aug 08 14:56:00 dist-test-slave-z8x9 krb5kdc[13600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200960, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:00.345465 14292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:00.325923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:37181 (local address 127.12.73.190:33363)
0808 14:56:00.326391 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:00.326397 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:00.327652 (+ 1255us) server_negotiation.cc:407] Connection header received
0808 14:56:00.330087 (+ 2435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:00.330092 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:00.330167 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:00.330278 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:00.331968 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.332826 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.334518 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.334943 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.335076 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:00.338577 (+ 3501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:00.338582 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:00.338585 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:00.338616 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:00.341842 (+ 3226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:00.342894 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:00.342897 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:00.342900 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:00.343030 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:00.343548 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:00.343551 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:00.343553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:00.343801 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:00.343920 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:00.344934 (+ 1014us) server_negotiation.cc:299] Negotiation successful
0808 14:56:00.345103 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":241,"threads_started":1}
I20260808 14:56:00.347159 14294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:00.326459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33363 (local address 127.12.73.130:37181)
0808 14:56:00.327296 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:00.327352 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:00.329786 (+ 2434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:00.330506 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:00.330514 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:00.331168 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:00.331785 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:00.331804 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.332992 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.332996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:00.334355 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:00.334368 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.335176 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.335183 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:00.335405 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:00.336140 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:00.336161 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:00.338353 (+ 2192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:00.341989 (+ 3636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:00.342002 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:00.342022 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:00.342758 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:00.343143 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:00.343152 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:00.343159 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:00.343430 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:00.343942 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:00.343954 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:00.344433 (+ 479us) client_negotiation.cc:769] Sending connection context
0808 14:56:00.344834 (+ 401us) client_negotiation.cc:240] Negotiation successful
0808 14:56:00.345509 (+ 675us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":304,"threads_started":1}
I20260808 14:56:00.348722 14289 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33363
I20260808 14:56:00.349052 14289 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:00.349853 14289 heartbeater.cc:511] Master 127.12.73.190:33363 requested a full tablet report, sending...
I20260808 14:56:00.351464 13680 ts_manager.cc:194] Registered new tserver with Master: 050a2d06eb254a779628691922134a95 (127.12.73.130:39981)
I20260808 14:56:00.352397 13680 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:37181
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:56:00.380304 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33363
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:00.739403 14299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:00.739787 14299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:00.739943 14299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:00.747861 14299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:00.747982 14299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:00.748103 14299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:56:00.758158 14299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33363
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:00.759508 14299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:00.760878 14299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:56:00.768558 14046 heartbeater.cc:503] Master 127.12.73.190:33363 was elected leader, sending a full tablet report...
W20260808 14:56:00.774600 14314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:00.774654 14307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:00.774680 14308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:00.775827 14299 server_base.cc:1034] running on GCE node
I20260808 14:56:00.776491 14299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:00.777566 14299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:00.778802 14299 hybrid_clock.cc:648] HybridClock initialized: now 1786200960778765 us; error 61 us; skew 500 ppm
I20260808 14:56:00.779124 14299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:00 dist-test-slave-z8x9 krb5kdc[13600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200960, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:00.782419 14299 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:56:00.783854 14299 webserver.cc:460] Webserver started at http://127.12.73.131:44689/ using document root <none> and password file <none>
I20260808 14:56:00.784538 14299 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:00.784690 14299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:00.785007 14299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:00.788108 14299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "9e4177ebd4ab433caa67f0d7a7491a09"
format_stamp: "Formatted at 2026-08-08 14:56:00 on dist-test-slave-z8x9"
server_key: "3ba5ee5c63ae05a0f27659d653e27684"
server_key_iv: "9e6bbeb3efb50b0c12aec086b3d521a0"
server_key_version: "encryptionkey@0"
I20260808 14:56:00.788930 14299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "9e4177ebd4ab433caa67f0d7a7491a09"
format_stamp: "Formatted at 2026-08-08 14:56:00 on dist-test-slave-z8x9"
server_key: "3ba5ee5c63ae05a0f27659d653e27684"
server_key_iv: "9e6bbeb3efb50b0c12aec086b3d521a0"
server_key_version: "encryptionkey@0"
I20260808 14:56:00.794126 14299 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 14:56:00.797586 14322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:00.798980 14299 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:56:00.799158 14299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "9e4177ebd4ab433caa67f0d7a7491a09"
format_stamp: "Formatted at 2026-08-08 14:56:00 on dist-test-slave-z8x9"
server_key: "3ba5ee5c63ae05a0f27659d653e27684"
server_key_iv: "9e6bbeb3efb50b0c12aec086b3d521a0"
server_key_version: "encryptionkey@0"
I20260808 14:56:00.799374 14299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:00.839685 14299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:00.843969 14299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:00.844295 14299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:00.845366 14299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:00.846935 14299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:00.847043 14299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:00.847193 14299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:00.847276 14299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:00.882457 14299 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:37453
I20260808 14:56:00.882521 14522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:37453 every 8 connection(s)
I20260808 14:56:00.883767 14299 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:56:00.892012 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 14299
I20260808 14:56:00.892232 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:56:00.892701 12582 external_mini_cluster.cc:1428] Setting key 118fc47649842f8ad85c73fc79c85cae
Aug 08 14:56:00 dist-test-slave-z8x9 krb5kdc[13600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200960, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:00.908823 14529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:00.886796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33363 (local address 127.12.73.131:48089)
0808 14:56:00.887579 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:00.887652 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:00.889646 (+ 1994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:00.890408 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:00.890416 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:00.890912 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:00.891443 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:00.891459 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.892802 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.892809 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:00.894747 (+ 1938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:00.894761 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.895802 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.895812 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:00.896147 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:00.897030 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:00.897068 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:00.900627 (+ 3559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:00.904456 (+ 3829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:00.904468 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:00.904487 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:00.905199 (+ 712us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:00.905542 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:00.905549 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:00.905556 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:00.905832 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:00.906367 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:00.906375 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:00.906783 (+ 408us) client_negotiation.cc:769] Sending connection context
0808 14:56:00.907090 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 14:56:00.907626 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":310,"threads_started":1}
I20260808 14:56:00.909813 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:00.886364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:48089 (local address 127.12.73.190:33363)
0808 14:56:00.886861 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:00.886866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:00.887817 (+ 951us) server_negotiation.cc:407] Connection header received
0808 14:56:00.889933 (+ 2116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:00.889940 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:00.890037 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:00.890156 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:00.891611 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.892612 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.894928 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.895533 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.895683 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:00.900933 (+ 5250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:00.900942 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:00.900948 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:00.900996 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:00.904322 (+ 3326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:00.905310 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:00.905314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:00.905317 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:00.905433 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:00.905948 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:00.905951 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:00.905953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:00.906210 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:00.906385 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:00.909368 (+ 2983us) server_negotiation.cc:299] Negotiation successful
0808 14:56:00.909528 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":279,"threads_started":1}
I20260808 14:56:00.910987 14523 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33363
I20260808 14:56:00.911293 14523 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:00.911996 14523 heartbeater.cc:511] Master 127.12.73.190:33363 requested a full tablet report, sending...
I20260808 14:56:00.913515 13680 ts_manager.cc:194] Registered new tserver with Master: 9e4177ebd4ab433caa67f0d7a7491a09 (127.12.73.131:37453)
I20260808 14:56:00.914877 13680 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:48089
I20260808 14:56:00.920578 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:56:00.940634 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:00.927201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46148 (local address 127.12.73.190:33363)
0808 14:56:00.927372 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:00.927376 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:00.927983 (+ 607us) server_negotiation.cc:407] Connection header received
0808 14:56:00.928186 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:00.928198 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:00.928260 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:00.928378 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:00.929928 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.930640 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.931952 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.932361 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.932499 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:00.935135 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:00.935141 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:00.935146 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:00.935188 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:00.937947 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:00.938592 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:00.938600 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:00.938603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:00.938732 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:00.939141 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:00.939149 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:00.939153 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:00.939486 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:00.939752 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:00.940102 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 14:56:00.940339 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:56:00.948091 13680 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:56:00.962208 13680 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:00.988478 14544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:00.977859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:37453 (local address 127.0.0.1:41770)
0808 14:56:00.978528 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:00.978570 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:00.978735 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:00.980156 (+ 1421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:00.980164 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:00.980194 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:00.980604 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:00.980617 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.982408 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.982415 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:00.984622 (+ 2207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:00.984637 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.987172 (+ 2535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.987181 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:00.987491 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:00.987565 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 14:56:00.987686 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 14:56:00.987928 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":687,"threads_started":1}
I20260808 14:56:00.990514 14545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:00.978842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41770 (local address 127.12.73.131:37453)
0808 14:56:00.979501 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:00.979507 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:00.979554 (+ 47us) server_negotiation.cc:407] Connection header received
0808 14:56:00.979677 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:00.979689 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:00.979942 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:00.980149 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:00.980851 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.982260 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.984824 (+ 2564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.986919 (+ 2095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.989417 (+ 2498us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:00.989737 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:00.989815 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 14:56:00.990043 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":1088,"threads_started":1}
I20260808 14:56:00.995182 14412 tablet_service.cc:1467] Processing CreateTablet for tablet fad4492e0b3b4b2590a620bde9b3cb56 (DEFAULT_TABLE table=test-table [id=9ed898b4ad76452e87ef96890cb9139f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:00.997031 14412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fad4492e0b3b4b2590a620bde9b3cb56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:01.002425 14544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:00.978250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:39981 (local address 127.0.0.1:43056)
0808 14:56:00.989063 (+ 10813us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:00.989084 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:00.989226 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:00.994217 (+ 4991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:00.994225 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:00.994257 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:00.994466 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:00.994478 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.996755 (+ 2277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.996763 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:00.999029 (+ 2266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:00.999047 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.001347 (+ 2300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.001356 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:01.001607 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.001679 (+ 72us) client_negotiation.cc:769] Sending connection context
0808 14:56:01.001758 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:56:01.001938 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10688,"mutex_wait_us":1299,"thread_start_us":12141,"threads_started":1}
I20260808 14:56:01.004266 14546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:00.979389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43056 (local address 127.12.73.130:39981)
0808 14:56:00.979913 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:00.979921 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:00.993287 (+ 13366us) server_negotiation.cc:407] Connection header received
0808 14:56:00.993418 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:00.993428 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:00.993711 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:00.993918 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:00.994669 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:00.996554 (+ 1885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:00.999264 (+ 2710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.001105 (+ 1841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.003138 (+ 2033us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.003394 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:01.003469 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 14:56:01.003678 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":355,"threads_started":1}
I20260808 14:56:01.010495 14174 tablet_service.cc:1467] Processing CreateTablet for tablet fad4492e0b3b4b2590a620bde9b3cb56 (DEFAULT_TABLE table=test-table [id=9ed898b4ad76452e87ef96890cb9139f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:01.012038 14174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fad4492e0b3b4b2590a620bde9b3cb56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:01.016667 14547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:00.983777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:35035 (local address 127.0.0.1:41838)
0808 14:56:00.990438 (+ 6661us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:00.990460 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:00.990585 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:01.006071 (+ 15486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:01.006078 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:01.006118 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:01.006554 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:01.006568 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.010459 (+ 3891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.010468 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:01.012966 (+ 2498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:01.012985 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.015473 (+ 2488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.015482 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:01.015838 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.015892 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 14:56:01.015975 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 14:56:01.016204 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6526,"threads_started":1}
I20260808 14:56:01.018218 14551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:00.984474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41838 (local address 127.12.73.129:35035)
0808 14:56:01.005085 (+ 20611us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:01.005098 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:01.005131 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:56:01.005268 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:01.005279 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:01.005535 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:01.005764 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:01.008198 (+ 2434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.010279 (+ 2081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.013237 (+ 2958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.015205 (+ 1968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.017109 (+ 1904us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.017463 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:01.017554 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 14:56:01.017773 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20394,"thread_start_us":20156,"threads_started":1}
I20260808 14:56:01.019470 14552 tablet_bootstrap.cc:492] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09: Bootstrap starting.
I20260808 14:56:01.023947 14552 tablet_bootstrap.cc:654] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:01.025527 14552 log.cc:824] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:01.030712 13917 tablet_service.cc:1467] Processing CreateTablet for tablet fad4492e0b3b4b2590a620bde9b3cb56 (DEFAULT_TABLE table=test-table [id=9ed898b4ad76452e87ef96890cb9139f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:01.031937 13917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fad4492e0b3b4b2590a620bde9b3cb56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:01.032505 14552 tablet_bootstrap.cc:492] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09: No bootstrap required, opened a new log
I20260808 14:56:01.032830 14552 ts_tablet_manager.cc:1397] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.007s
I20260808 14:56:01.047662 14552 raft_consensus.cc:348] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 37453 } } peers { permanent_uuid: "050a2d06eb254a779628691922134a95" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39981 } } peers { permanent_uuid: "bcfd44330d7d4ff1979da54588b496bc" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35035 } }
I20260808 14:56:01.048398 14552 raft_consensus.cc:374] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:01.048590 14552 raft_consensus.cc:729] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e4177ebd4ab433caa67f0d7a7491a09, State: Initialized, Role: FOLLOWER
I20260808 14:56:01.049474 14552 consensus_queue.cc:260] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 37453 } } peers { permanent_uuid: "050a2d06eb254a779628691922134a95" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39981 } } peers { permanent_uuid: "bcfd44330d7d4ff1979da54588b496bc" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35035 } }
I20260808 14:56:01.049592 14555 tablet_bootstrap.cc:492] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95: Bootstrap starting.
I20260808 14:56:01.051119 14560 tablet_bootstrap.cc:492] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc: Bootstrap starting.
I20260808 14:56:01.053020 14555 tablet_bootstrap.cc:654] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:01.054464 14555 log.cc:824] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:01.055559 14560 tablet_bootstrap.cc:654] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:01.056512 14523 heartbeater.cc:503] Master 127.12.73.190:33363 was elected leader, sending a full tablet report...
I20260808 14:56:01.057210 14552 ts_tablet_manager.cc:1428] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09: Time spent starting tablet: real 0.024s user 0.017s sys 0.009s
I20260808 14:56:01.059159 14560 log.cc:824] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:01.062577 14560 tablet_bootstrap.cc:492] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc: No bootstrap required, opened a new log
I20260808 14:56:01.062932 14560 ts_tablet_manager.cc:1397] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s
I20260808 14:56:01.063208 14555 tablet_bootstrap.cc:492] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95: No bootstrap required, opened a new log
I20260808 14:56:01.063493 14555 ts_tablet_manager.cc:1397] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s
I20260808 14:56:01.071308 14560 raft_consensus.cc:348] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 37453 } } peers { permanent_uuid: "050a2d06eb254a779628691922134a95" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39981 } } peers { permanent_uuid: "bcfd44330d7d4ff1979da54588b496bc" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35035 } }
I20260808 14:56:01.071697 14560 raft_consensus.cc:374] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:01.071833 14560 raft_consensus.cc:729] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcfd44330d7d4ff1979da54588b496bc, State: Initialized, Role: FOLLOWER
I20260808 14:56:01.072492 14560 consensus_queue.cc:260] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 37453 } } peers { permanent_uuid: "050a2d06eb254a779628691922134a95" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39981 } } peers { permanent_uuid: "bcfd44330d7d4ff1979da54588b496bc" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35035 } }
I20260808 14:56:01.074112 14560 ts_tablet_manager.cc:1428] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc: Time spent starting tablet: real 0.011s user 0.007s sys 0.003s
I20260808 14:56:01.076853 14555 raft_consensus.cc:348] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 37453 } } peers { permanent_uuid: "050a2d06eb254a779628691922134a95" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39981 } } peers { permanent_uuid: "bcfd44330d7d4ff1979da54588b496bc" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35035 } }
I20260808 14:56:01.077271 14555 raft_consensus.cc:374] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:01.077384 14555 raft_consensus.cc:729] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050a2d06eb254a779628691922134a95, State: Initialized, Role: FOLLOWER
I20260808 14:56:01.078027 14555 consensus_queue.cc:260] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 37453 } } peers { permanent_uuid: "050a2d06eb254a779628691922134a95" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39981 } } peers { permanent_uuid: "bcfd44330d7d4ff1979da54588b496bc" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35035 } }
I20260808 14:56:01.079350 14289 heartbeater.cc:503] Master 127.12.73.190:33363 was elected leader, sending a full tablet report...
I20260808 14:56:01.080008 14555 ts_tablet_manager.cc:1428] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260808 14:56:01.108733 14562 raft_consensus.cc:482] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:01.109056 14562 raft_consensus.cc:504] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 37453 } } peers { permanent_uuid: "050a2d06eb254a779628691922134a95" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39981 } } peers { permanent_uuid: "bcfd44330d7d4ff1979da54588b496bc" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35035 } }
I20260808 14:56:01.111002 14562 leader_election.cc:288] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 050a2d06eb254a779628691922134a95 (127.12.73.130:39981), bcfd44330d7d4ff1979da54588b496bc (127.12.73.129:35035)
I20260808 14:56:01.118327 14529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:01.111152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:39981 (local address 127.12.73.131:40355)
0808 14:56:01.111491 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:01.111513 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:01.111645 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:01.112401 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:01.112411 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:01.112445 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:01.112678 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:01.112692 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.114070 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.114076 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:01.115595 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:01.115609 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.117588 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.117595 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:01.117776 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.117815 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:56:01.117914 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:56:01.118052 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160}
I20260808 14:56:01.118466 14546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:01.111553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:40355 (local address 127.12.73.130:39981)
0808 14:56:01.111907 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:01.111915 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:01.111937 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:56:01.112020 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:01.112025 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:01.112102 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:01.112193 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:01.112890 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.113937 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.115796 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.117425 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.117605 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.117720 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:01.117957 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 14:56:01.118125 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183}
I20260808 14:56:01.119534 14213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad4492e0b3b4b2590a620bde9b3cb56" candidate_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050a2d06eb254a779628691922134a95" is_pre_election: true
I20260808 14:56:01.120119 14213 raft_consensus.cc:2454] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e4177ebd4ab433caa67f0d7a7491a09 in term 0.
I20260808 14:56:01.120560 14551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:01.112113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:56287 (local address 127.12.73.129:35035)
0808 14:56:01.112336 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:01.112345 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:01.112797 (+ 452us) server_negotiation.cc:407] Connection header received
0808 14:56:01.112939 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:01.112947 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:01.113041 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:01.113146 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:01.113802 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.115190 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.117650 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.119191 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.119346 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.119429 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:01.120058 (+ 629us) server_negotiation.cc:299] Negotiation successful
0808 14:56:01.120202 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:56:01.121115 14572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:01.111484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:35035 (local address 127.12.73.131:56287)
0808 14:56:01.112680 (+ 1196us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:01.112698 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:01.112819 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:01.113219 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:01.113225 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:01.113251 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:01.113617 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:01.113627 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.115361 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.115366 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:01.117432 (+ 2066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:01.117444 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.119568 (+ 2124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.119575 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:01.119752 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.119894 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 14:56:01.120751 (+ 857us) client_negotiation.cc:240] Negotiation successful
0808 14:56:01.120887 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1062,"thread_start_us":855,"threads_started":1}
I20260808 14:56:01.121929 14328 leader_election.cc:302] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050a2d06eb254a779628691922134a95, 9e4177ebd4ab433caa67f0d7a7491a09; no voters:
I20260808 14:56:01.122459 14562 raft_consensus.cc:2781] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:01.122275 13960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad4492e0b3b4b2590a620bde9b3cb56" candidate_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcfd44330d7d4ff1979da54588b496bc" is_pre_election: true
I20260808 14:56:01.122610 14562 raft_consensus.cc:482] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:01.122707 14562 raft_consensus.cc:3037] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:01.122885 13960 raft_consensus.cc:2454] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e4177ebd4ab433caa67f0d7a7491a09 in term 0.
I20260808 14:56:01.125547 14562 raft_consensus.cc:504] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 37453 } } peers { permanent_uuid: "050a2d06eb254a779628691922134a95" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39981 } } peers { permanent_uuid: "bcfd44330d7d4ff1979da54588b496bc" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35035 } }
I20260808 14:56:01.126206 14562 leader_election.cc:288] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [CANDIDATE]: Term 1 election: Requested vote from peers 050a2d06eb254a779628691922134a95 (127.12.73.130:39981), bcfd44330d7d4ff1979da54588b496bc (127.12.73.129:35035)
I20260808 14:56:01.126601 14213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad4492e0b3b4b2590a620bde9b3cb56" candidate_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050a2d06eb254a779628691922134a95"
I20260808 14:56:01.126816 14213 raft_consensus.cc:3037] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:01.126870 13960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad4492e0b3b4b2590a620bde9b3cb56" candidate_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcfd44330d7d4ff1979da54588b496bc"
I20260808 14:56:01.127061 13960 raft_consensus.cc:3037] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:01.130189 14213 raft_consensus.cc:2454] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e4177ebd4ab433caa67f0d7a7491a09 in term 1.
I20260808 14:56:01.130410 13960 raft_consensus.cc:2454] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e4177ebd4ab433caa67f0d7a7491a09 in term 1.
I20260808 14:56:01.130628 14328 leader_election.cc:302] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050a2d06eb254a779628691922134a95, 9e4177ebd4ab433caa67f0d7a7491a09; no voters:
I20260808 14:56:01.131055 14562 raft_consensus.cc:2781] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:01.131610 14562 raft_consensus.cc:686] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [term 1 LEADER]: Becoming Leader. State: Replica: 9e4177ebd4ab433caa67f0d7a7491a09, State: Running, Role: LEADER
I20260808 14:56:01.132157 14562 consensus_queue.cc:237] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 37453 } } peers { permanent_uuid: "050a2d06eb254a779628691922134a95" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39981 } } peers { permanent_uuid: "bcfd44330d7d4ff1979da54588b496bc" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35035 } }
W20260808 14:56:01.135447 14524 tablet.cc:2369] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:56:01.137076 13678 catalog_manager.cc:5495] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e4177ebd4ab433caa67f0d7a7491a09 (127.12.73.131). New cstate: current_term: 1 leader_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e4177ebd4ab433caa67f0d7a7491a09" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "050a2d06eb254a779628691922134a95" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcfd44330d7d4ff1979da54588b496bc" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35035 } health_report { overall_health: UNKNOWN } } }
Aug 08 14:56:01 dist-test-slave-z8x9 krb5kdc[13600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:56:01.160351 14551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:01.143449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41850 (local address 127.12.73.129:35035)
0808 14:56:01.143626 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:01.143634 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:01.144291 (+ 657us) server_negotiation.cc:407] Connection header received
0808 14:56:01.144512 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:01.144517 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:01.144597 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:01.144711 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:01.146289 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.147089 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.148339 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.148776 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.148918 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.152948 (+ 4030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:01.152960 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:01.152974 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:01.153005 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:01.157308 (+ 4303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:01.158137 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:01.158149 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:01.158152 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:01.158300 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:01.158682 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:01.158688 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:01.158691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:01.159068 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:01.159404 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:01.159693 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 14:56:01.159936 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 14:56:01 dist-test-slave-z8x9 krb5kdc[13600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200961, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:56:01 dist-test-slave-z8x9 krb5kdc[13600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200961, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:56:01.213799 14551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:01.197658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41852 (local address 127.12.73.129:35035)
0808 14:56:01.197920 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:01.197929 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:01.198815 (+ 886us) server_negotiation.cc:407] Connection header received
0808 14:56:01.199023 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:01.199027 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:01.199096 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:01.199185 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:01.201312 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.202107 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.204312 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.204770 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.204879 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.208838 (+ 3959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:01.208843 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:01.208847 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:01.208883 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:01.211554 (+ 2671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:01.212131 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:01.212135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:01.212137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:01.212273 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:01.212612 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:01.212615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:01.212617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:01.212883 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:01.213102 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:01.213370 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 14:56:01.213543 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
W20260808 14:56:01.239241 14047 tablet.cc:2369] T fad4492e0b3b4b2590a620bde9b3cb56 P bcfd44330d7d4ff1979da54588b496bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 14:56:01 dist-test-slave-z8x9 krb5kdc[13600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:56:01 dist-test-slave-z8x9 krb5kdc[13600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:56:01.263808 14551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:01.249843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41856 (local address 127.12.73.129:35035)
0808 14:56:01.250113 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:01.250120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:01.250380 (+ 260us) server_negotiation.cc:407] Connection header received
0808 14:56:01.250490 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:01.250494 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:01.250562 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:01.250660 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:01.252050 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.252772 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.254047 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.254526 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.254630 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.258728 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:01.258733 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:01.258737 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:01.258770 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:01.261422 (+ 2652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:01.262008 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:01.262012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:01.262014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:01.262140 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:01.262451 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:01.262455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:01.262456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:01.262802 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:01.262987 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:01.263245 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 14:56:01.263418 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260808 14:56:01.265982 13883 tablet_service.cc:2908] Rejecting scan request for tablet fad4492e0b3b4b2590a620bde9b3cb56: Uninitialized: clean time has not yet been initialized
I20260808 14:56:01.269521 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 13804
I20260808 14:56:01.281304 14551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:01.270514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41866 (local address 127.12.73.129:35035)
0808 14:56:01.270705 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:01.270710 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:01.271090 (+ 380us) server_negotiation.cc:407] Connection header received
0808 14:56:01.271204 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:01.271207 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:01.271272 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:01.271350 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:01.272428 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.273076 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.274253 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.274658 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.274784 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.276857 (+ 2073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:01.276862 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:01.276865 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:01.276890 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:01.279227 (+ 2337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:01.279803 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:01.279807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:01.279809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:01.279921 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:01.280227 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:01.280230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:01.280232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:01.280471 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:01.280680 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:01.280858 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 14:56:01.281007 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:56:01.281908 14040 generic_service.cc:196] Checking for leaks (request via RPC)
W20260808 14:56:01.325548 14291 tablet.cc:2369] T fad4492e0b3b4b2590a620bde9b3cb56 P 050a2d06eb254a779628691922134a95: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:56:01.371618 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 13804
I20260808 14:56:01.399827 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 14055
Aug 08 14:56:01 dist-test-slave-z8x9 krb5kdc[13600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:56:01.414480 14546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:01.400602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43058 (local address 127.12.73.130:39981)
0808 14:56:01.400824 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:01.400830 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:01.400851 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:56:01.401012 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:01.401025 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:01.401101 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:01.401310 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:01.402585 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.403395 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.404683 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.405085 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.405244 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.409301 (+ 4057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:01.409318 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:01.409334 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:01.409368 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:01.412045 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:01.412666 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:01.412672 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:01.412675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:01.412810 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:01.413135 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:01.413138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:01.413140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:01.413568 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:01.413826 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:01.414041 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 14:56:01.414216 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 14:56:01.415241 14281 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:01.504441 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 14055
I20260808 14:56:01.517550 14572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:01.516909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:35035 (local address 127.12.73.131:50289)
0808 14:56:01.517158 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:01.517346 (+ 188us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:35035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 14:56:01.517890 14324 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.73.129:35035: connect: Connection refused (error 111)
I20260808 14:56:01.519488 14572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:01.519007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:35035 (local address 127.12.73.131:60351)
0808 14:56:01.519200 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:01.519305 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:35035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 14:56:01.519707 14324 consensus_peers.cc:487] T fad4492e0b3b4b2590a620bde9b3cb56 P 9e4177ebd4ab433caa67f0d7a7491a09 -> Peer bcfd44330d7d4ff1979da54588b496bc (127.12.73.129:35035): Couldn't send request to peer bcfd44330d7d4ff1979da54588b496bc. Status: Network error: Client connection negotiation failed: client connection to 127.12.73.129:35035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 14:56:01.531096 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 14299
Aug 08 14:56:01 dist-test-slave-z8x9 krb5kdc[13600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:56:01.546159 14601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:01.531850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41776 (local address 127.12.73.131:37453)
0808 14:56:01.532320 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:01.532325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:01.532353 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:56:01.532407 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:01.532411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:01.532470 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:01.532560 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:01.533867 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.534612 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.535876 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:01.536266 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:01.536362 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:01.540621 (+ 4259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:01.540637 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:01.540654 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:01.540691 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:01.543614 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:01.544211 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:01.544218 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:01.544220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:01.544354 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:01.544674 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:01.544677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:01.544679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:01.545015 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:01.545311 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:01.545596 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 14:56:01.545765 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":273,"threads_started":1}
I20260808 14:56:01.546774 14513 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:01.637544 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 14299
I20260808 14:56:01.662925 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 13625
I20260808 14:56:01.664083 13749 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:01.774309 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 13625
2026-08-08T14:56:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4603 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:56:01 dist-test-slave-z8x9 krb5kdc[14610](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:56:01 dist-test-slave-z8x9 krb5kdc[14610](info): set up 2 sockets
Aug 08 14:56:01 dist-test-slave-z8x9 krb5kdc[14610](info): commencing operation
krb5kdc: starting...
W20260808 14:56:03.098114 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.004s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:56:03 dist-test-slave-z8x9 krb5kdc[14610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:56:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:56:03.306607 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:39493
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:40523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:39493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:03.627584 14631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:03.627976 14631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:03.628155 14631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:03.635434 14631 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:03.635567 14631 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:56:03.635640 14631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:03.635731 14631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:03.635799 14631 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:03.635880 14631 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:03.645762 14631 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:39493
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:39493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:03.647046 14631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:03.648411 14631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:03.660506 14646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:03.660544 14650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:03.660429 14647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:03.661424 14631 server_base.cc:1034] running on GCE node
I20260808 14:56:03.662248 14631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:03.663712 14631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:03.664937 14631 hybrid_clock.cc:648] HybridClock initialized: now 1786200963664856 us; error 46 us; skew 500 ppm
I20260808 14:56:03.665335 14631 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:03 dist-test-slave-z8x9 krb5kdc[14610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200963, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:03.668543 14631 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:56:03.670042 14631 webserver.cc:460] Webserver started at http://127.12.73.190:46115/ using document root <none> and password file <none>
I20260808 14:56:03.670718 14631 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:03.670814 14631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:03.671087 14631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:03.674157 14631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "567d4cc3de6e4c6d8087e62e0c2c3ff9"
format_stamp: "Formatted at 2026-08-08 14:56:03 on dist-test-slave-z8x9"
server_key: "df541dd468fcd42b67bfea954db8ac79"
server_key_iv: "30488605e0a28b77a384b2f99ad65c6a"
server_key_version: "encryptionkey@0"
I20260808 14:56:03.674919 14631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "567d4cc3de6e4c6d8087e62e0c2c3ff9"
format_stamp: "Formatted at 2026-08-08 14:56:03 on dist-test-slave-z8x9"
server_key: "df541dd468fcd42b67bfea954db8ac79"
server_key_iv: "30488605e0a28b77a384b2f99ad65c6a"
server_key_version: "encryptionkey@0"
I20260808 14:56:03.680259 14631 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260808 14:56:03.683802 14663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:03.685497 14631 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:03.685652 14631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "567d4cc3de6e4c6d8087e62e0c2c3ff9"
format_stamp: "Formatted at 2026-08-08 14:56:03 on dist-test-slave-z8x9"
server_key: "df541dd468fcd42b67bfea954db8ac79"
server_key_iv: "30488605e0a28b77a384b2f99ad65c6a"
server_key_version: "encryptionkey@0"
I20260808 14:56:03.685873 14631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:03.703708 14631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:03.707885 14631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:03.708112 14631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:03.730343 14631 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:39493
I20260808 14:56:03.730384 14776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:39493 every 8 connection(s)
I20260808 14:56:03.731756 14631 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:03.735663 14777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:03.735787 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 14631
I20260808 14:56:03.736018 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:03.736899 12582 external_mini_cluster.cc:1428] Setting key f57e37fe42d6fe014d95c0bf67928653
I20260808 14:56:03.749918 14777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9: Bootstrap starting.
Aug 08 14:56:03 dist-test-slave-z8x9 krb5kdc[14610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:03.753849 14777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:03.755090 14777 log.cc:824] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:03.758069 14777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9: No bootstrap required, opened a new log
I20260808 14:56:03.761649 14788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:03.739149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48638 (local address 127.12.73.190:39493)
0808 14:56:03.740000 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:03.740011 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:03.740054 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:56:03.742242 (+ 2188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:03.742267 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:03.742671 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:03.743017 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:03.744762 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:03.746192 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:03.747988 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:03.748898 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:03.749040 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:03.754107 (+ 5067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:03.754115 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:03.754129 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:03.754169 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:03.757495 (+ 3326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:03.758198 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:03.758214 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:03.758220 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:03.758410 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:03.758824 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:03.758832 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:03.758835 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:03.759381 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:03.759709 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:03.760148 (+ 439us) server_negotiation.cc:299] Negotiation successful
0808 14:56:03.760591 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":415,"threads_started":1}
I20260808 14:56:03.766471 14777 raft_consensus.cc:348] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "567d4cc3de6e4c6d8087e62e0c2c3ff9" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 39493 } }
I20260808 14:56:03.766942 14777 raft_consensus.cc:374] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:03.767058 14777 raft_consensus.cc:729] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567d4cc3de6e4c6d8087e62e0c2c3ff9, State: Initialized, Role: FOLLOWER
I20260808 14:56:03.767590 14777 consensus_queue.cc:260] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "567d4cc3de6e4c6d8087e62e0c2c3ff9" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 39493 } }
I20260808 14:56:03.767841 14777 raft_consensus.cc:388] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:03.767983 14777 raft_consensus.cc:482] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:03.768165 14777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:03.770684 14777 raft_consensus.cc:504] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "567d4cc3de6e4c6d8087e62e0c2c3ff9" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 39493 } }
I20260808 14:56:03.771234 14777 leader_election.cc:302] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 567d4cc3de6e4c6d8087e62e0c2c3ff9; no voters:
I20260808 14:56:03.771761 14777 leader_election.cc:288] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:03.771940 14790 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:03.772708 14790 raft_consensus.cc:686] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [term 1 LEADER]: Becoming Leader. State: Replica: 567d4cc3de6e4c6d8087e62e0c2c3ff9, State: Running, Role: LEADER
I20260808 14:56:03.773339 14790 consensus_queue.cc:237] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "567d4cc3de6e4c6d8087e62e0c2c3ff9" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 39493 } }
I20260808 14:56:03.773967 14777 sys_catalog.cc:564] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:03.776543 14798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 567d4cc3de6e4c6d8087e62e0c2c3ff9. Latest consensus state: current_term: 1 leader_uuid: "567d4cc3de6e4c6d8087e62e0c2c3ff9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "567d4cc3de6e4c6d8087e62e0c2c3ff9" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 39493 } } }
I20260808 14:56:03.776919 14798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:03.779175 14810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:03.779081 14793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "567d4cc3de6e4c6d8087e62e0c2c3ff9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "567d4cc3de6e4c6d8087e62e0c2c3ff9" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 39493 } } }
I20260808 14:56:03.779390 14793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:03.784590 14810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:03.794013 14810 catalog_manager.cc:1347] Generated new cluster ID: d988c49ecac14395addd7d51e4ed0e43
I20260808 14:56:03.794128 14810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:03.808069 14810 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:03.809911 14810 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:03.816777 14810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9: Generated new TSK 0
I20260808 14:56:03.817806 14810 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:56:03.874569 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:39493
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:40523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:04.210690 14831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:04.211028 14831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:04.211215 14831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:04.219087 14831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:04.219245 14831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:04.219395 14831 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:56:04.219549 14831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:56:04.229326 14831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.73.190:39493
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:04.230677 14831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:04.232019 14831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:04.245471 14841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:04.245471 14843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:04.245975 14851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:04.246534 14831 server_base.cc:1034] running on GCE node
I20260808 14:56:04.247126 14831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:04.247992 14831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:04.249264 14831 hybrid_clock.cc:648] HybridClock initialized: now 1786200964249138 us; error 53 us; skew 500 ppm
I20260808 14:56:04.249526 14831 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:04 dist-test-slave-z8x9 krb5kdc[14610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200964, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:04.257426 14831 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:56:04.259018 14831 webserver.cc:460] Webserver started at http://127.12.73.129:46653/ using document root <none> and password file <none>
I20260808 14:56:04.259742 14831 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:04.259837 14831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:04.260211 14831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:04.263236 14831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "2de62634d03440d9969b7ac12662edf4"
format_stamp: "Formatted at 2026-08-08 14:56:04 on dist-test-slave-z8x9"
server_key: "0437ba3d53b1a390c028bf3e6d905bdc"
server_key_iv: "203f41b6371fcea4ccb73fc1934caa09"
server_key_version: "encryptionkey@0"
I20260808 14:56:04.264060 14831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "2de62634d03440d9969b7ac12662edf4"
format_stamp: "Formatted at 2026-08-08 14:56:04 on dist-test-slave-z8x9"
server_key: "0437ba3d53b1a390c028bf3e6d905bdc"
server_key_iv: "203f41b6371fcea4ccb73fc1934caa09"
server_key_version: "encryptionkey@0"
I20260808 14:56:04.269666 14831 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:56:04.273138 14871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:04.274648 14831 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 14:56:04.274824 14831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "2de62634d03440d9969b7ac12662edf4"
format_stamp: "Formatted at 2026-08-08 14:56:04 on dist-test-slave-z8x9"
server_key: "0437ba3d53b1a390c028bf3e6d905bdc"
server_key_iv: "203f41b6371fcea4ccb73fc1934caa09"
server_key_version: "encryptionkey@0"
I20260808 14:56:04.275032 14831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:04.293640 14831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:04.298026 14831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:04.298265 14831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:04.300949 14831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:04.301082 14831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:04.301267 14831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:04.301352 14831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:56:04 dist-test-slave-z8x9 krb5kdc[14610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200964, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:04.325896 14889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:04.301718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:40373 (local address 127.12.73.190:39493)
0808 14:56:04.302367 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:04.302373 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:04.303418 (+ 1045us) server_negotiation.cc:407] Connection header received
0808 14:56:04.305742 (+ 2324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:04.305752 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:04.305871 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:04.306029 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:04.308280 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.309425 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.311879 (+ 2454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.312527 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.312683 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:04.318356 (+ 5673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:04.318363 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:04.318367 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:04.318415 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:04.321674 (+ 3259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:04.322741 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:04.322748 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:04.322752 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:04.322898 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:04.323556 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:04.323564 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:04.323567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:04.323976 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:04.324131 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:04.325259 (+ 1128us) server_negotiation.cc:299] Negotiation successful
0808 14:56:04.325504 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":435,"threads_started":1}
I20260808 14:56:04.328524 14897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:04.302400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:39493 (local address 127.12.73.129:40373)
0808 14:56:04.303239 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:04.303280 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:04.305392 (+ 2112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:04.306194 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:04.306201 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:04.306920 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:04.308060 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:04.308094 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.309611 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.309622 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:04.311708 (+ 2086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:04.311724 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.312854 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.312866 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:04.313141 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:04.314127 (+ 986us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:04.314179 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:04.318036 (+ 3857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:04.321817 (+ 3781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:04.321826 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:04.321841 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:04.322604 (+ 763us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:04.323016 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:04.323021 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:04.323025 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:04.323388 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:04.324204 (+ 816us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:04.324210 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:04.324727 (+ 517us) client_negotiation.cc:769] Sending connection context
0808 14:56:04.326245 (+ 1518us) client_negotiation.cc:240] Negotiation successful
0808 14:56:04.326832 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":390,"threads_started":1}
I20260808 14:56:04.348587 14831 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:33945
I20260808 14:56:04.348625 15103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:33945 every 8 connection(s)
I20260808 14:56:04.350014 14831 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:56:04.350832 14889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:04.335918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:46549 (local address 127.12.73.190:39493)
0808 14:56:04.336126 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:04.336135 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:04.336936 (+ 801us) server_negotiation.cc:407] Connection header received
0808 14:56:04.337248 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:04.337255 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:04.337321 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:04.337430 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:04.338492 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.339381 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.341633 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.342294 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.342449 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:04.344478 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:04.344487 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:04.344494 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:04.344541 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:04.347849 (+ 3308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:04.348690 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:04.348696 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:04.348700 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:04.348887 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:04.349307 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:04.349313 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:04.349316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:04.349616 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:04.349780 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:04.350233 (+ 453us) server_negotiation.cc:299] Negotiation successful
0808 14:56:04.350470 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:56:04.350987 15056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:04.335949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:39493 (local address 127.12.73.129:46549)
0808 14:56:04.336796 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:04.336827 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:04.337067 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:04.337462 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:04.337467 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:04.337999 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:04.338336 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:04.338347 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.339519 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.339530 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:04.341489 (+ 1959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:04.341503 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.342511 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.342522 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:04.342699 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:04.343502 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:04.343519 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:04.344259 (+ 740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:04.347982 (+ 3723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:04.347988 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:04.347992 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:04.348537 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:04.349012 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:04.349018 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:04.349022 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:04.349205 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:04.349742 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:04.349747 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:04.349952 (+ 205us) client_negotiation.cc:769] Sending connection context
0808 14:56:04.350106 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 14:56:04.350456 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":504,"threads_started":1}
I20260808 14:56:04.352820 15109 heartbeater.cc:347] Connected to a master server at 127.12.73.190:39493
I20260808 14:56:04.353084 15109 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:04.353994 15109 heartbeater.cc:511] Master 127.12.73.190:39493 requested a full tablet report, sending...
I20260808 14:56:04.355959 14695 ts_manager.cc:194] Registered new tserver with Master: 2de62634d03440d9969b7ac12662edf4 (127.12.73.129:33945)
I20260808 14:56:04.356983 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 14831
I20260808 14:56:04.357271 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:56:04.357595 14695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:40373
I20260808 14:56:04.357973 12582 external_mini_cluster.cc:1428] Setting key 2e1d9017799b89baea02951447ba71f6
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:56:04.402069 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:39493
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:40523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:04.744032 15113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:04.744302 15113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:04.744400 15113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:04.751484 15113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:04.751591 15113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:04.751684 15113 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:56:04.751765 15113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:56:04.761557 15113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.73.190:39493
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:04.762732 15113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:04.764482 15113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:04.778163 15127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:04.778465 15118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:04.779098 15120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:04.779116 15113 server_base.cc:1034] running on GCE node
I20260808 14:56:04.780133 15113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:04.781322 15113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:04.782570 15113 hybrid_clock.cc:648] HybridClock initialized: now 1786200964782460 us; error 83 us; skew 500 ppm
I20260808 14:56:04.782845 15113 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:04 dist-test-slave-z8x9 krb5kdc[14610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200964, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:04.786224 15113 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:56:04.787611 15113 webserver.cc:460] Webserver started at http://127.12.73.130:40561/ using document root <none> and password file <none>
I20260808 14:56:04.788255 15113 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:04.788352 15113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:04.788627 15113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:04.791812 15113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272"
format_stamp: "Formatted at 2026-08-08 14:56:04 on dist-test-slave-z8x9"
server_key: "08e9e629f2e1543d9de67927509ebe9d"
server_key_iv: "4fff0cdeac6ea58ee2e0d3e1145cbf9a"
server_key_version: "encryptionkey@0"
I20260808 14:56:04.792551 15113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272"
format_stamp: "Formatted at 2026-08-08 14:56:04 on dist-test-slave-z8x9"
server_key: "08e9e629f2e1543d9de67927509ebe9d"
server_key_iv: "4fff0cdeac6ea58ee2e0d3e1145cbf9a"
server_key_version: "encryptionkey@0"
I20260808 14:56:04.797652 15113 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260808 14:56:04.801003 15138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:04.802385 15113 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:04.802561 15113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272"
format_stamp: "Formatted at 2026-08-08 14:56:04 on dist-test-slave-z8x9"
server_key: "08e9e629f2e1543d9de67927509ebe9d"
server_key_iv: "4fff0cdeac6ea58ee2e0d3e1145cbf9a"
server_key_version: "encryptionkey@0"
I20260808 14:56:04.802757 15113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:04.816871 15113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:04.820942 15113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:04.821215 15113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:04.823763 15113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:04.823872 15113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:04.824009 15113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:04.824100 15113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:56:04 dist-test-slave-z8x9 krb5kdc[14610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200964, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:04.848950 14889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:04.824530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:57565 (local address 127.12.73.190:39493)
0808 14:56:04.824744 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:04.824751 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:04.826234 (+ 1483us) server_negotiation.cc:407] Connection header received
0808 14:56:04.828274 (+ 2040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:04.828280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:04.828381 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:04.828497 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:04.830695 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.832080 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.834768 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.835565 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.835718 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:04.841040 (+ 5322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:04.841046 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:04.841049 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:04.841085 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:04.844950 (+ 3865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:04.846074 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:04.846083 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:04.846088 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:04.846280 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:04.846820 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:04.846826 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:04.846829 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:04.847167 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:04.847367 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:04.848526 (+ 1159us) server_negotiation.cc:299] Negotiation successful
0808 14:56:04.848698 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:56:04.851338 15148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:04.825196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:39493 (local address 127.12.73.130:57565)
0808 14:56:04.826062 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:04.826112 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:04.827994 (+ 1882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:04.828733 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:04.828740 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:04.829497 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:04.830435 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:04.830479 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.832240 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.832251 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:04.834533 (+ 2282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:04.834546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.835789 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.835798 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:04.836139 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:04.837022 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:04.837064 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:04.840751 (+ 3687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:04.845151 (+ 4400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:04.845164 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:04.845213 (+ 49us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:04.845907 (+ 694us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:04.846416 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:04.846421 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:04.846425 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:04.846674 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:04.847348 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:04.847362 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:04.847989 (+ 627us) client_negotiation.cc:769] Sending connection context
0808 14:56:04.848411 (+ 422us) client_negotiation.cc:240] Negotiation successful
0808 14:56:04.849213 (+ 802us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":384,"threads_started":1}
I20260808 14:56:04.875219 14889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:04.858991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:34273 (local address 127.12.73.190:39493)
0808 14:56:04.859172 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:04.859176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:04.859855 (+ 679us) server_negotiation.cc:407] Connection header received
0808 14:56:04.860052 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:04.860056 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:04.860116 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:04.860217 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:04.861142 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.862197 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.864718 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.865136 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.865329 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:04.867960 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:04.867967 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:04.867971 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:04.868012 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:04.871696 (+ 3684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:04.872411 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:04.872419 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:04.872426 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:04.872640 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:04.873009 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:04.873017 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:04.873023 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:04.873579 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:04.873744 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:04.874829 (+ 1085us) server_negotiation.cc:299] Negotiation successful
0808 14:56:04.874982 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:56:04.875392 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:04.859104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:39493 (local address 127.12.73.130:34273)
0808 14:56:04.859752 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:04.859772 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:04.859927 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:04.860244 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:04.860248 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:04.860713 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:04.861002 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:04.861010 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.862350 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.862360 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:04.864559 (+ 2199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:04.864580 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:04.865409 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:04.865418 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:04.865681 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:04.866556 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:04.866586 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:04.867769 (+ 1183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:04.871833 (+ 4064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:04.871839 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:04.871849 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:04.872238 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:04.872773 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:04.872776 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:04.872778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:04.872904 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:04.873752 (+ 848us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:04.873759 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:04.873993 (+ 234us) client_negotiation.cc:769] Sending connection context
0808 14:56:04.874225 (+ 232us) client_negotiation.cc:240] Negotiation successful
0808 14:56:04.874635 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":334,"threads_started":1}
I20260808 14:56:04.879889 15113 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:46575
I20260808 14:56:04.879908 15340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:46575 every 8 connection(s)
I20260808 14:56:04.881248 15113 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:56:04.882897 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 15113
I20260808 14:56:04.883116 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:56:04.883471 15342 heartbeater.cc:347] Connected to a master server at 127.12.73.190:39493
I20260808 14:56:04.883703 15342 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:04.883737 12582 external_mini_cluster.cc:1428] Setting key 22c3cc03d8cb7e17b7cc530d7ab494b7
I20260808 14:56:04.884434 15342 heartbeater.cc:511] Master 127.12.73.190:39493 requested a full tablet report, sending...
I20260808 14:56:04.885910 14695 ts_manager.cc:194] Registered new tserver with Master: 6cd7b3a0b39b4375b18ae8ba5cc44272 (127.12.73.130:46575)
I20260808 14:56:04.886691 14695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:57565
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:56:04.928418 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:39493
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:40523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:05.262035 15346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:05.262344 15346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:05.262552 15346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:05.270330 15346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:05.270448 15346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:05.270632 15346 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:56:05.270764 15346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:56:05.281222 15346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.73.190:39493
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:05.282666 15346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:05.284047 15346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:05.298298 15355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:05.298413 15356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:05.298413 15363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:05.299548 15346 server_base.cc:1034] running on GCE node
I20260808 14:56:05.300310 15346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:05.301533 15346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:05.302831 15346 hybrid_clock.cc:648] HybridClock initialized: now 1786200965302749 us; error 43 us; skew 500 ppm
I20260808 14:56:05.303187 15346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:05 dist-test-slave-z8x9 krb5kdc[14610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200965, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:05.306882 15346 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:56:05.308480 15346 webserver.cc:460] Webserver started at http://127.12.73.131:42957/ using document root <none> and password file <none>
I20260808 14:56:05.309468 15346 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:05.309605 15346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:05.309937 15346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:05.312798 15346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "0abbeacbb49b48ef851b60a936c5221e"
format_stamp: "Formatted at 2026-08-08 14:56:05 on dist-test-slave-z8x9"
server_key: "bc3b8764336df156a98554211d89d29f"
server_key_iv: "75427e4e6e767b45532d97641be3ed69"
server_key_version: "encryptionkey@0"
I20260808 14:56:05.313632 15346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "0abbeacbb49b48ef851b60a936c5221e"
format_stamp: "Formatted at 2026-08-08 14:56:05 on dist-test-slave-z8x9"
server_key: "bc3b8764336df156a98554211d89d29f"
server_key_iv: "75427e4e6e767b45532d97641be3ed69"
server_key_version: "encryptionkey@0"
I20260808 14:56:05.318840 15346 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:56:05.322429 15376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:05.323772 15346 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:56:05.323969 15346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "0abbeacbb49b48ef851b60a936c5221e"
format_stamp: "Formatted at 2026-08-08 14:56:05 on dist-test-slave-z8x9"
server_key: "bc3b8764336df156a98554211d89d29f"
server_key_iv: "75427e4e6e767b45532d97641be3ed69"
server_key_version: "encryptionkey@0"
I20260808 14:56:05.324199 15346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:05.345988 15346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:05.351577 15346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:05.351881 15346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:05.355371 15346 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:05.355489 15346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:05.355636 15346 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:05.355731 15346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:05.360632 15109 heartbeater.cc:503] Master 127.12.73.190:39493 was elected leader, sending a full tablet report...
Aug 08 14:56:05 dist-test-slave-z8x9 krb5kdc[14610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200965, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:05.380952 14889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.356020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:33997 (local address 127.12.73.190:39493)
0808 14:56:05.356265 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:05.356274 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:05.357864 (+ 1590us) server_negotiation.cc:407] Connection header received
0808 14:56:05.359862 (+ 1998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:05.359868 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:05.359961 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:05.360073 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:05.362915 (+ 2842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.364008 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.366684 (+ 2676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.367151 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.367294 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.372223 (+ 4929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:05.372232 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:05.372237 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:05.372284 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:05.376472 (+ 4188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:05.377498 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:05.377508 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:05.377512 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:05.377719 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:05.378484 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:05.378493 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:05.378499 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:05.378950 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:05.379182 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:05.380209 (+ 1027us) server_negotiation.cc:299] Negotiation successful
0808 14:56:05.380497 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 14:56:05.382601 15394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.356562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:39493 (local address 127.12.73.131:33997)
0808 14:56:05.357696 (+ 1134us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:05.357746 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:05.359562 (+ 1816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:05.360348 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:05.360361 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:05.361783 (+ 1422us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:05.362725 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.362758 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.364176 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.364184 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.366498 (+ 2314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.366523 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.367400 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.367408 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.367628 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.368513 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:05.368571 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:05.371981 (+ 3410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:05.376637 (+ 4656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:05.376658 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:05.376684 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:05.377338 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:05.377901 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:05.377907 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:05.377911 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:05.378242 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:05.379127 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:05.379141 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:05.379706 (+ 565us) client_negotiation.cc:769] Sending connection context
0808 14:56:05.380091 (+ 385us) client_negotiation.cc:240] Negotiation successful
0808 14:56:05.380766 (+ 675us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":830,"thread_start_us":583,"threads_started":1}
I20260808 14:56:05.407577 15346 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:38193
I20260808 14:56:05.407598 15588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:38193 every 8 connection(s)
I20260808 14:56:05.408807 15346 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:56:05.408948 15492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.389483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:39493 (local address 127.12.73.131:38337)
0808 14:56:05.390560 (+ 1077us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:05.390587 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:05.390786 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:05.391380 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:05.391386 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:05.392243 (+ 857us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:05.392794 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.392809 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.394539 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.394550 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.396866 (+ 2316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.396887 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.398386 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.398395 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.398582 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.399343 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:05.399375 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:05.400851 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:05.405497 (+ 4646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:05.405501 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:05.405504 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:05.406032 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:05.406569 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:05.406577 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:05.406583 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:05.406768 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:05.407572 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:05.407577 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:05.407858 (+ 281us) client_negotiation.cc:769] Sending connection context
0808 14:56:05.408023 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 14:56:05.408398 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":870,"thread_start_us":629,"threads_started":1}
I20260808 14:56:05.408941 14889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.389023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:38337 (local address 127.12.73.190:39493)
0808 14:56:05.389230 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:05.389239 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:05.390698 (+ 1459us) server_negotiation.cc:407] Connection header received
0808 14:56:05.390942 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:05.390950 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:05.391051 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:05.391164 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:05.393016 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.394305 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.397083 (+ 2778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.397940 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.398075 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.401101 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:05.401108 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:05.401114 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:05.401161 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:05.405353 (+ 4192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:05.406212 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:05.406221 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:05.406227 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:05.406405 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:05.406996 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:05.407005 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:05.407009 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:05.407408 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:05.407587 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:05.408129 (+ 542us) server_negotiation.cc:299] Negotiation successful
0808 14:56:05.408481 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:56:05.411055 15589 heartbeater.cc:347] Connected to a master server at 127.12.73.190:39493
I20260808 14:56:05.411381 15589 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:05.412079 15589 heartbeater.cc:511] Master 127.12.73.190:39493 requested a full tablet report, sending...
I20260808 14:56:05.413584 14695 ts_manager.cc:194] Registered new tserver with Master: 0abbeacbb49b48ef851b60a936c5221e (127.12.73.131:38193)
I20260808 14:56:05.414332 14695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:33997
I20260808 14:56:05.418846 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 15346
I20260808 14:56:05.419049 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:56:05.419481 12582 external_mini_cluster.cc:1428] Setting key 9611ad4e1947db7c83af7e0b37a3f8b5
I20260808 14:56:05.422282 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:56:05 dist-test-slave-z8x9 krb5kdc[14610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200965, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:56:05 dist-test-slave-z8x9 krb5kdc[14610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200965, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:05.472795 14889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.458417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48646 (local address 127.12.73.190:39493)
0808 14:56:05.458656 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:05.458663 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:05.458979 (+ 316us) server_negotiation.cc:407] Connection header received
0808 14:56:05.459201 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:05.459205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:05.459270 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:05.459392 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:05.460806 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.461607 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.462862 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.463297 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.463448 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.467495 (+ 4047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:05.467500 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:05.467503 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:05.467538 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:05.470166 (+ 2628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:05.470787 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:05.470794 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:05.470797 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:05.470934 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:05.471324 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:05.471329 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:05.471332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:05.471621 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:05.471882 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:05.472187 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 14:56:05.472429 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 14:56:05.477016 14695 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48646:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:56:05.483917 14695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:05.506006 15605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.495656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:46575 (local address 127.0.0.1:33636)
0808 14:56:05.497007 (+ 1351us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:05.497061 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:05.497361 (+ 300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:05.498385 (+ 1024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:05.498394 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:05.498433 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:05.498897 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.498912 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.500885 (+ 1973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.500891 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.503202 (+ 2311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.503217 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.504903 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.504910 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.505177 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.505256 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 14:56:05.505379 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 14:56:05.505568 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1084,"mutex_wait_us":3,"thread_start_us":893,"threads_started":1}
I20260808 14:56:05.506151 15607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.495908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33636 (local address 127.12.73.130:46575)
0808 14:56:05.496396 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:05.496403 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:05.497188 (+ 785us) server_negotiation.cc:407] Connection header received
0808 14:56:05.497627 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:05.497637 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:05.497891 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:05.498063 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:05.499122 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.500706 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.503384 (+ 2678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.504700 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.504851 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.505074 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:05.505701 (+ 627us) server_negotiation.cc:299] Negotiation successful
0808 14:56:05.505866 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":252,"threads_started":1}
I20260808 14:56:05.506485 15609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.497429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43782 (local address 127.12.73.131:38193)
0808 14:56:05.498129 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:05.498135 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:05.498159 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:56:05.498300 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:05.498310 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:05.498516 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:05.499442 (+ 926us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:05.499753 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.501359 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.503419 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.504863 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.505227 (+ 364us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.505446 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:05.505518 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 14:56:05.505684 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":1334,"threads_started":1}
I20260808 14:56:05.507241 15611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.498042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:33945 (local address 127.0.0.1:53462)
0808 14:56:05.498583 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:05.498607 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:05.498727 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:05.499918 (+ 1191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:05.499923 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:05.499944 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:05.500302 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.500316 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.502117 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.502122 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.504279 (+ 2157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.504296 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.506456 (+ 2160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.506464 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.506653 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.506688 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:56:05.506785 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 14:56:05.506904 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":900,"threads_started":1}
I20260808 14:56:05.507359 15612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.498610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53462 (local address 127.12.73.129:33945)
0808 14:56:05.499499 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:05.499505 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:05.499525 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:56:05.499594 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:05.499599 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:05.499731 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:05.499918 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:05.500521 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.501967 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.504473 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.505957 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.506087 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.506298 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:05.506827 (+ 529us) server_negotiation.cc:299] Negotiation successful
0808 14:56:05.507067 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":624,"threads_started":1}
I20260808 14:56:05.510176 15608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.496784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:38193 (local address 127.0.0.1:43782)
0808 14:56:05.497426 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:05.497443 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:05.497550 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:05.498729 (+ 1179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:05.498737 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:05.498759 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:05.499252 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.499266 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.501498 (+ 2232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.501504 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.503254 (+ 1750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.503267 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.505097 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.505103 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.505358 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.505394 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 14:56:05.505461 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:56:05.505568 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"mutex_wait_us":61,"thread_start_us":921,"threads_started":1}
I20260808 14:56:05.509689 15211 tablet_service.cc:1467] Processing CreateTablet for tablet f0fca70ccbf64f879ea4cc4ee9c9c810 (DEFAULT_TABLE table=test-table [id=22dc727c582743f99001325054cff27e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:05.511129 15211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0fca70ccbf64f879ea4cc4ee9c9c810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:05.512431 14975 tablet_service.cc:1467] Processing CreateTablet for tablet f0fca70ccbf64f879ea4cc4ee9c9c810 (DEFAULT_TABLE table=test-table [id=22dc727c582743f99001325054cff27e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:05.512862 15459 tablet_service.cc:1467] Processing CreateTablet for tablet f0fca70ccbf64f879ea4cc4ee9c9c810 (DEFAULT_TABLE table=test-table [id=22dc727c582743f99001325054cff27e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:05.513795 14975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0fca70ccbf64f879ea4cc4ee9c9c810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:05.514191 15459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0fca70ccbf64f879ea4cc4ee9c9c810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:05.524647 15613 tablet_bootstrap.cc:492] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e: Bootstrap starting.
I20260808 14:56:05.529093 15613 tablet_bootstrap.cc:654] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:05.530155 15613 log.cc:824] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:05.532757 15616 tablet_bootstrap.cc:492] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4: Bootstrap starting.
I20260808 14:56:05.533504 15613 tablet_bootstrap.cc:492] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e: No bootstrap required, opened a new log
I20260808 14:56:05.533776 15613 ts_tablet_manager.cc:1397] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 14:56:05.535316 15615 tablet_bootstrap.cc:492] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Bootstrap starting.
I20260808 14:56:05.535749 15616 tablet_bootstrap.cc:654] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:05.537035 15616 log.cc:824] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:05.538604 15615 tablet_bootstrap.cc:654] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:05.539822 15615 log.cc:824] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:05.540181 15616 tablet_bootstrap.cc:492] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4: No bootstrap required, opened a new log
I20260808 14:56:05.540537 15616 ts_tablet_manager.cc:1397] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260808 14:56:05.541791 15613 raft_consensus.cc:348] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } }
I20260808 14:56:05.542145 15613 raft_consensus.cc:374] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:05.542238 15613 raft_consensus.cc:729] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0abbeacbb49b48ef851b60a936c5221e, State: Initialized, Role: FOLLOWER
I20260808 14:56:05.542830 15613 consensus_queue.cc:260] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } }
I20260808 14:56:05.544536 15613 ts_tablet_manager.cc:1428] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260808 14:56:05.545073 15589 heartbeater.cc:503] Master 127.12.73.190:39493 was elected leader, sending a full tablet report...
I20260808 14:56:05.549147 15615 tablet_bootstrap.cc:492] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272: No bootstrap required, opened a new log
I20260808 14:56:05.549455 15615 ts_tablet_manager.cc:1397] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.010s
I20260808 14:56:05.553634 15616 raft_consensus.cc:348] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } }
I20260808 14:56:05.554076 15616 raft_consensus.cc:374] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:05.554177 15616 raft_consensus.cc:729] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2de62634d03440d9969b7ac12662edf4, State: Initialized, Role: FOLLOWER
I20260808 14:56:05.554809 15616 consensus_queue.cc:260] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } }
I20260808 14:56:05.556648 15616 ts_tablet_manager.cc:1428] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4: Time spent starting tablet: real 0.016s user 0.007s sys 0.007s
I20260808 14:56:05.559888 15615 raft_consensus.cc:348] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } }
I20260808 14:56:05.560199 15615 raft_consensus.cc:374] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:05.560314 15615 raft_consensus.cc:729] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd7b3a0b39b4375b18ae8ba5cc44272, State: Initialized, Role: FOLLOWER
I20260808 14:56:05.560971 15615 consensus_queue.cc:260] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } }
I20260808 14:56:05.561962 15342 heartbeater.cc:503] Master 127.12.73.190:39493 was elected leader, sending a full tablet report...
I20260808 14:56:05.562384 15615 ts_tablet_manager.cc:1428] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
W20260808 14:56:05.603255 15110 tablet.cc:2369] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:56:05.628496 15624 raft_consensus.cc:482] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:05.628790 15624 raft_consensus.cc:504] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } }
I20260808 14:56:05.630494 15624 leader_election.cc:288] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cd7b3a0b39b4375b18ae8ba5cc44272 (127.12.73.130:46575), 0abbeacbb49b48ef851b60a936c5221e (127.12.73.131:38193)
W20260808 14:56:05.635103 15343 tablet.cc:2369] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:56:05.637648 15609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.630914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:32859 (local address 127.12.73.131:38193)
0808 14:56:05.631131 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:05.631141 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:05.632001 (+ 860us) server_negotiation.cc:407] Connection header received
0808 14:56:05.632224 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:05.632228 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:05.632288 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:05.632389 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:05.633087 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.633828 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.635805 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.636585 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.636787 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.636875 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:05.637254 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 14:56:05.637379 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:56:05.637804 15607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.631007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:56355 (local address 127.12.73.130:46575)
0808 14:56:05.631255 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:05.631264 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:05.631957 (+ 693us) server_negotiation.cc:407] Connection header received
0808 14:56:05.632181 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:05.632185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:05.632244 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:05.632345 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:05.632954 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.633756 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.636045 (+ 2289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.636793 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.637003 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.637078 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:05.637411 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 14:56:05.637543 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 14:56:05.637853 15629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.631034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:38193 (local address 127.12.73.129:32859)
0808 14:56:05.631881 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:05.631900 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:05.632066 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:05.632408 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:05.632412 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:05.632437 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:05.632925 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.632934 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.633978 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.633983 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.635644 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.635657 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.636886 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.636895 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.637039 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.637070 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 14:56:05.637198 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 14:56:05.637326 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"mutex_wait_us":30,"spinlock_wait_cycles":1792,"thread_start_us":524,"threads_started":1}
I20260808 14:56:05.637974 15628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.630914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:46575 (local address 127.12.73.129:56355)
0808 14:56:05.631838 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:05.631853 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:05.632033 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:05.632370 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:05.632374 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:05.632399 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:05.632799 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.632812 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.633890 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.633898 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.635873 (+ 1975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.635888 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.637030 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.637036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.637251 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.637275 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:56:05.637385 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:56:05.637512 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":785,"mutex_wait_us":27,"spinlock_wait_cycles":768,"thread_start_us":569,"threads_started":1}
I20260808 14:56:05.638975 15261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0fca70ccbf64f879ea4cc4ee9c9c810" candidate_uuid: "2de62634d03440d9969b7ac12662edf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" is_pre_election: true
I20260808 14:56:05.638989 15499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0fca70ccbf64f879ea4cc4ee9c9c810" candidate_uuid: "2de62634d03440d9969b7ac12662edf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0abbeacbb49b48ef851b60a936c5221e" is_pre_election: true
I20260808 14:56:05.639479 15261 raft_consensus.cc:2454] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2de62634d03440d9969b7ac12662edf4 in term 0.
I20260808 14:56:05.639508 15499 raft_consensus.cc:2454] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2de62634d03440d9969b7ac12662edf4 in term 0.
I20260808 14:56:05.640130 14879 leader_election.cc:302] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2de62634d03440d9969b7ac12662edf4, 6cd7b3a0b39b4375b18ae8ba5cc44272; no voters:
I20260808 14:56:05.640547 15624 raft_consensus.cc:2781] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:05.640671 15624 raft_consensus.cc:482] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:05.640744 15624 raft_consensus.cc:3037] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:05.643008 15624 raft_consensus.cc:504] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } }
I20260808 14:56:05.643635 15624 leader_election.cc:288] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [CANDIDATE]: Term 1 election: Requested vote from peers 6cd7b3a0b39b4375b18ae8ba5cc44272 (127.12.73.130:46575), 0abbeacbb49b48ef851b60a936c5221e (127.12.73.131:38193)
I20260808 14:56:05.644006 15499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0fca70ccbf64f879ea4cc4ee9c9c810" candidate_uuid: "2de62634d03440d9969b7ac12662edf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0abbeacbb49b48ef851b60a936c5221e"
I20260808 14:56:05.644016 15261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0fca70ccbf64f879ea4cc4ee9c9c810" candidate_uuid: "2de62634d03440d9969b7ac12662edf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272"
I20260808 14:56:05.644205 15499 raft_consensus.cc:3037] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:05.644214 15261 raft_consensus.cc:3037] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:05.646492 15261 raft_consensus.cc:2454] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2de62634d03440d9969b7ac12662edf4 in term 1.
I20260808 14:56:05.646524 15499 raft_consensus.cc:2454] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2de62634d03440d9969b7ac12662edf4 in term 1.
I20260808 14:56:05.646930 14879 leader_election.cc:302] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2de62634d03440d9969b7ac12662edf4, 6cd7b3a0b39b4375b18ae8ba5cc44272; no voters:
I20260808 14:56:05.647248 15624 raft_consensus.cc:2781] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:05.647691 15624 raft_consensus.cc:686] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 1 LEADER]: Becoming Leader. State: Replica: 2de62634d03440d9969b7ac12662edf4, State: Running, Role: LEADER
I20260808 14:56:05.648243 15624 consensus_queue.cc:237] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } }
I20260808 14:56:05.652674 14695 catalog_manager.cc:5495] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2de62634d03440d9969b7ac12662edf4 (127.12.73.129). New cstate: current_term: 1 leader_uuid: "2de62634d03440d9969b7ac12662edf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } health_report { overall_health: HEALTHY } } }
W20260808 14:56:05.660629 15590 tablet.cc:2369] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:56:05.707747 15612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.702392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53478 (local address 127.12.73.129:33945)
0808 14:56:05.702646 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:05.702651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:05.702671 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:56:05.702921 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:05.702924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:05.703011 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:05.703128 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:05.703484 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.704181 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.705540 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.705966 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.706113 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.706545 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:05.707016 (+ 471us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:05.707123 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:05.707355 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 14:56:05.707432 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:56:05.716090 15499 raft_consensus.cc:1261] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e [term 1 FOLLOWER]: Refusing update from remote peer 2de62634d03440d9969b7ac12662edf4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:05.716091 15261 raft_consensus.cc:1261] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 1 FOLLOWER]: Refusing update from remote peer 2de62634d03440d9969b7ac12662edf4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:05.717051 15630 consensus_queue.cc:1035] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:05.717581 15624 consensus_queue.cc:1035] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:05.753028 14693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:05.753427 14693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:05.757442 14693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9: Sending DeleteTablet for 3 replicas of tablet f0fca70ccbf64f879ea4cc4ee9c9c810
I20260808 14:56:05.758625 15211 tablet_service.cc:1514] Processing DeleteTablet for tablet f0fca70ccbf64f879ea4cc4ee9c9c810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:05 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:33636
I20260808 14:56:05.758796 15459 tablet_service.cc:1514] Processing DeleteTablet for tablet f0fca70ccbf64f879ea4cc4ee9c9c810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:05 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:43782
I20260808 14:56:05.759009 14975 tablet_service.cc:1514] Processing DeleteTablet for tablet f0fca70ccbf64f879ea4cc4ee9c9c810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:05 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:53462
I20260808 14:56:05.761343 14693 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48646:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:56:05.762956 14693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:05.769883 15658 tablet_replica.cc:330] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4: stopping tablet replica
I20260808 14:56:05.770403 15658 raft_consensus.cc:2229] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:56:05.771119 15658 raft_consensus.cc:2258] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:05.773998 14975 tablet_service.cc:1467] Processing CreateTablet for tablet 3fff3994bd4b4ce1860905b4e50ee7aa (DEFAULT_TABLE table=test-table [id=0e00f9d69224491abf45c548d69dba92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:05.774497 14975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fff3994bd4b4ce1860905b4e50ee7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:05.774297 15460 tablet_service.cc:1467] Processing CreateTablet for tablet 3fff3994bd4b4ce1860905b4e50ee7aa (DEFAULT_TABLE table=test-table [id=0e00f9d69224491abf45c548d69dba92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:05.774454 15208 tablet_service.cc:1467] Processing CreateTablet for tablet 3fff3994bd4b4ce1860905b4e50ee7aa (DEFAULT_TABLE table=test-table [id=0e00f9d69224491abf45c548d69dba92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:05.775027 15208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fff3994bd4b4ce1860905b4e50ee7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:05.775063 15460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fff3994bd4b4ce1860905b4e50ee7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:05.781809 15658 ts_tablet_manager.cc:1905] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:05.784267 15616 tablet_bootstrap.cc:492] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4: Bootstrap starting.
I20260808 14:56:05.786279 15616 tablet_bootstrap.cc:654] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:05.786908 15615 tablet_bootstrap.cc:492] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272: Bootstrap starting.
I20260808 14:56:05.789238 15615 tablet_bootstrap.cc:654] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:05.791392 15657 tablet_replica.cc:330] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e: stopping tablet replica
I20260808 14:56:05.791955 15657 raft_consensus.cc:2229] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:05.792588 15657 raft_consensus.cc:2258] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:05.792870 15613 tablet_bootstrap.cc:492] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e: Bootstrap starting.
I20260808 14:56:05.794804 15613 tablet_bootstrap.cc:654] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:05.795711 15654 tablet_replica.cc:330] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272: stopping tablet replica
I20260808 14:56:05.796150 15654 raft_consensus.cc:2229] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:05.796669 15654 raft_consensus.cc:2258] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:05.799212 15654 ts_tablet_manager.cc:1905] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:05.800072 15657 ts_tablet_manager.cc:1905] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:05.803375 15616 tablet_bootstrap.cc:492] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4: No bootstrap required, opened a new log
I20260808 14:56:05.803546 15616 ts_tablet_manager.cc:1397] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.000s
I20260808 14:56:05.804426 15616 raft_consensus.cc:348] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:05.804677 15616 raft_consensus.cc:374] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:05.804793 15616 raft_consensus.cc:729] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2de62634d03440d9969b7ac12662edf4, State: Initialized, Role: FOLLOWER
I20260808 14:56:05.805114 15616 consensus_queue.cc:260] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:05.805708 15616 ts_tablet_manager.cc:1428] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:56:05.806437 15654 ts_tablet_manager.cc:1918] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:05.806597 15654 log.cc:1196] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/f0fca70ccbf64f879ea4cc4ee9c9c810
I20260808 14:56:05.807287 15615 tablet_bootstrap.cc:492] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272: No bootstrap required, opened a new log
I20260808 14:56:05.807343 15654 ts_tablet_manager.cc:1939] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Deleting consensus metadata
I20260808 14:56:05.807456 15615 ts_tablet_manager.cc:1397] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.005s
I20260808 14:56:05.808382 15615 raft_consensus.cc:348] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:05.808645 15615 raft_consensus.cc:374] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:05.808768 15615 raft_consensus.cc:729] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd7b3a0b39b4375b18ae8ba5cc44272, State: Initialized, Role: FOLLOWER
I20260808 14:56:05.809140 15615 consensus_queue.cc:260] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:05.809765 15658 ts_tablet_manager.cc:1918] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:05.809970 15658 log.cc:1196] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/f0fca70ccbf64f879ea4cc4ee9c9c810
I20260808 14:56:05.810271 14669 catalog_manager.cc:4841] TS 6cd7b3a0b39b4375b18ae8ba5cc44272 (127.12.73.130:46575): tablet f0fca70ccbf64f879ea4cc4ee9c9c810 (table test-table [id=22dc727c582743f99001325054cff27e]) successfully deleted
I20260808 14:56:05.810513 15615 ts_tablet_manager.cc:1428] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:56:05.810575 15658 ts_tablet_manager.cc:1939] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 2de62634d03440d9969b7ac12662edf4: Deleting consensus metadata
I20260808 14:56:05.812268 14664 catalog_manager.cc:4841] TS 2de62634d03440d9969b7ac12662edf4 (127.12.73.129:33945): tablet f0fca70ccbf64f879ea4cc4ee9c9c810 (table test-table [id=22dc727c582743f99001325054cff27e]) successfully deleted
I20260808 14:56:05.813885 15613 tablet_bootstrap.cc:492] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e: No bootstrap required, opened a new log
I20260808 14:56:05.814225 15613 ts_tablet_manager.cc:1397] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.007s
I20260808 14:56:05.815148 15613 raft_consensus.cc:348] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:05.815425 15613 raft_consensus.cc:374] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:05.815539 15613 raft_consensus.cc:729] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0abbeacbb49b48ef851b60a936c5221e, State: Initialized, Role: FOLLOWER
I20260808 14:56:05.815864 15613 consensus_queue.cc:260] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:05.816509 15613 ts_tablet_manager.cc:1428] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:56:05.817646 15657 ts_tablet_manager.cc:1918] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:05.817832 15657 log.cc:1196] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/f0fca70ccbf64f879ea4cc4ee9c9c810
I20260808 14:56:05.818416 15657 ts_tablet_manager.cc:1939] T f0fca70ccbf64f879ea4cc4ee9c9c810 P 0abbeacbb49b48ef851b60a936c5221e: Deleting consensus metadata
I20260808 14:56:05.819942 14664 catalog_manager.cc:4841] TS 0abbeacbb49b48ef851b60a936c5221e (127.12.73.131:38193): tablet f0fca70ccbf64f879ea4cc4ee9c9c810 (table test-table [id=22dc727c582743f99001325054cff27e]) successfully deleted
I20260808 14:56:05.903806 15624 raft_consensus.cc:482] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:05.904044 15624 raft_consensus.cc:504] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:05.904704 15624 leader_election.cc:288] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cd7b3a0b39b4375b18ae8ba5cc44272 (127.12.73.130:46575), 0abbeacbb49b48ef851b60a936c5221e (127.12.73.131:38193)
I20260808 14:56:05.905292 15261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fff3994bd4b4ce1860905b4e50ee7aa" candidate_uuid: "2de62634d03440d9969b7ac12662edf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" is_pre_election: true
I20260808 14:56:05.905293 15499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fff3994bd4b4ce1860905b4e50ee7aa" candidate_uuid: "2de62634d03440d9969b7ac12662edf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0abbeacbb49b48ef851b60a936c5221e" is_pre_election: true
I20260808 14:56:05.905536 15261 raft_consensus.cc:2454] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2de62634d03440d9969b7ac12662edf4 in term 0.
I20260808 14:56:05.905561 15499 raft_consensus.cc:2454] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2de62634d03440d9969b7ac12662edf4 in term 0.
I20260808 14:56:05.906018 14879 leader_election.cc:302] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2de62634d03440d9969b7ac12662edf4, 6cd7b3a0b39b4375b18ae8ba5cc44272; no voters:
I20260808 14:56:05.906327 15624 raft_consensus.cc:2781] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:05.906461 15624 raft_consensus.cc:482] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:05.906558 15624 raft_consensus.cc:3037] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:05.909888 15624 raft_consensus.cc:504] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:05.910539 15624 leader_election.cc:288] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [CANDIDATE]: Term 1 election: Requested vote from peers 6cd7b3a0b39b4375b18ae8ba5cc44272 (127.12.73.130:46575), 0abbeacbb49b48ef851b60a936c5221e (127.12.73.131:38193)
I20260808 14:56:05.911012 15261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fff3994bd4b4ce1860905b4e50ee7aa" candidate_uuid: "2de62634d03440d9969b7ac12662edf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272"
I20260808 14:56:05.911010 15499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fff3994bd4b4ce1860905b4e50ee7aa" candidate_uuid: "2de62634d03440d9969b7ac12662edf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0abbeacbb49b48ef851b60a936c5221e"
I20260808 14:56:05.911216 15261 raft_consensus.cc:3037] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:05.911216 15499 raft_consensus.cc:3037] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:05.914034 15261 raft_consensus.cc:2454] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2de62634d03440d9969b7ac12662edf4 in term 1.
I20260808 14:56:05.914146 15499 raft_consensus.cc:2454] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2de62634d03440d9969b7ac12662edf4 in term 1.
I20260808 14:56:05.914435 14879 leader_election.cc:302] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2de62634d03440d9969b7ac12662edf4, 6cd7b3a0b39b4375b18ae8ba5cc44272; no voters:
I20260808 14:56:05.914731 15624 raft_consensus.cc:2781] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:05.914898 15624 raft_consensus.cc:686] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 1 LEADER]: Becoming Leader. State: Replica: 2de62634d03440d9969b7ac12662edf4, State: Running, Role: LEADER
I20260808 14:56:05.915176 15624 consensus_queue.cc:237] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:05.917860 14695 catalog_manager.cc:5495] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2de62634d03440d9969b7ac12662edf4 (127.12.73.129). New cstate: current_term: 1 leader_uuid: "2de62634d03440d9969b7ac12662edf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } health_report { overall_health: UNKNOWN } } }
Aug 08 14:56:05 dist-test-slave-z8x9 krb5kdc[14610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200963, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:05.984133 14889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.967647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48648 (local address 127.12.73.190:39493)
0808 14:56:05.967889 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:05.967898 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:05.968534 (+ 636us) server_negotiation.cc:407] Connection header received
0808 14:56:05.968727 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:05.968731 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:05.968806 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:05.968884 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:05.970488 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.971217 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.973094 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.973891 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.974021 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.978509 (+ 4488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:05.978515 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:05.978519 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:05.978557 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:05.981313 (+ 2756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:05.982015 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:05.982023 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:05.982027 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:05.982162 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:05.982564 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:05.982570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:05.982574 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:05.982840 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:05.983004 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:05.983449 (+ 445us) server_negotiation.cc:299] Negotiation successful
0808 14:56:05.983778 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":130,"server-negotiator.queue_time_us":67}
I20260808 14:56:05.984172 15677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:05.967666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:39493 (local address 127.0.0.1:48648)
0808 14:56:05.968408 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:05.968436 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:05.968594 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:05.968955 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:05.968960 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:05.969956 (+ 996us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:05.970319 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.970333 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.971356 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.971361 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.972926 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:05.972942 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:05.975027 (+ 2085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:05.975034 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:05.975204 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:05.976004 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:05.976021 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:05.978328 (+ 2307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:05.981441 (+ 3113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:05.981456 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:05.981464 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:05.981920 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:05.982306 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:05.982311 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:05.982314 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:05.982456 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:05.982975 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:05.982983 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:05.983155 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 14:56:05.983349 (+ 194us) client_negotiation.cc:240] Negotiation successful
0808 14:56:05.983648 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":412,"threads_started":1}
I20260808 14:56:05.989806 14695 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:48648:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:56:05.991021 14695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:05.998018 14975 tablet_service.cc:1467] Processing CreateTablet for tablet ab01e075add4427cafb585faa5f53f56 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e464703732a74e5d94f8d92daa3eed25]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:56:05.997958 15211 tablet_service.cc:1467] Processing CreateTablet for tablet ab01e075add4427cafb585faa5f53f56 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e464703732a74e5d94f8d92daa3eed25]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:56:05.998217 15460 tablet_service.cc:1467] Processing CreateTablet for tablet ab01e075add4427cafb585faa5f53f56 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e464703732a74e5d94f8d92daa3eed25]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:56:05.998559 15211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab01e075add4427cafb585faa5f53f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:05.998558 14975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab01e075add4427cafb585faa5f53f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:05.998796 15460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab01e075add4427cafb585faa5f53f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:06.006071 15616 tablet_bootstrap.cc:492] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4: Bootstrap starting.
I20260808 14:56:06.006165 15615 tablet_bootstrap.cc:492] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Bootstrap starting.
I20260808 14:56:06.006350 15613 tablet_bootstrap.cc:492] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: Bootstrap starting.
I20260808 14:56:06.007930 15616 tablet_bootstrap.cc:654] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:06.007925 15615 tablet_bootstrap.cc:654] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:06.008106 15613 tablet_bootstrap.cc:654] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:06.018774 15613 tablet_bootstrap.cc:492] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: No bootstrap required, opened a new log
I20260808 14:56:06.018967 15613 ts_tablet_manager.cc:1397] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260808 14:56:06.019500 15615 tablet_bootstrap.cc:492] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272: No bootstrap required, opened a new log
I20260808 14:56:06.019666 15615 ts_tablet_manager.cc:1397] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.008s
I20260808 14:56:06.019876 15613 raft_consensus.cc:348] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:06.020139 15613 raft_consensus.cc:374] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:06.020231 15613 raft_consensus.cc:729] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0abbeacbb49b48ef851b60a936c5221e, State: Initialized, Role: FOLLOWER
I20260808 14:56:06.020387 15615 raft_consensus.cc:348] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:06.020632 15615 raft_consensus.cc:374] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:06.020540 15613 consensus_queue.cc:260] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:06.020710 15615 raft_consensus.cc:729] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd7b3a0b39b4375b18ae8ba5cc44272, State: Initialized, Role: FOLLOWER
I20260808 14:56:06.021050 15616 tablet_bootstrap.cc:492] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4: No bootstrap required, opened a new log
I20260808 14:56:06.020987 15615 consensus_queue.cc:260] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:06.021086 15620 tablet_replica.cc:439] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } }
I20260808 14:56:06.021409 15620 tablet_replica.cc:442] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:06.021531 15616 ts_tablet_manager.cc:1397] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.002s
I20260808 14:56:06.021463 15627 tablet_replica.cc:439] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } }
I20260808 14:56:06.021852 15627 tablet_replica.cc:442] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:06.022540 15616 raft_consensus.cc:348] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:06.022890 15616 raft_consensus.cc:374] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:06.023033 15616 raft_consensus.cc:729] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2de62634d03440d9969b7ac12662edf4, State: Initialized, Role: FOLLOWER
I20260808 14:56:06.023367 15616 consensus_queue.cc:260] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:06.023643 15613 ts_tablet_manager.cc:1428] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260808 14:56:06.024138 15616 ts_tablet_manager.cc:1428] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:56:06.024433 15624 tablet_replica.cc:439] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } }
I20260808 14:56:06.024791 15624 tablet_replica.cc:442] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:06.025548 15615 ts_tablet_manager.cc:1428] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260808 14:56:06.209954 15620 raft_consensus.cc:482] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:06.210206 15620 raft_consensus.cc:504] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:06.211766 15620 leader_election.cc:288] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2de62634d03440d9969b7ac12662edf4 (127.12.73.129:33945), 6cd7b3a0b39b4375b18ae8ba5cc44272 (127.12.73.130:46575)
I20260808 14:56:06.227998 15682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.212148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:53421 (local address 127.12.73.129:33945)
0808 14:56:06.222452 (+ 10304us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:06.222457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:06.222472 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:56:06.222533 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:06.222537 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:06.222595 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:06.222715 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:06.223229 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.224432 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.226149 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.227010 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.227176 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.227251 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:06.227516 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 14:56:06.227650 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10156,"thread_start_us":10035,"threads_started":1}
I20260808 14:56:06.228044 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.211945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:33945 (local address 127.12.73.131:53421)
0808 14:56:06.222084 (+ 10139us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:06.222109 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:06.222283 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:06.222743 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:06.222748 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:06.222778 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:06.223045 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:06.223054 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.224571 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.224583 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:06.225987 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:06.225999 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.227165 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.227170 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:06.227351 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.227375 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:56:06.227479 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 14:56:06.227606 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10022,"thread_start_us":10527,"threads_started":1}
I20260808 14:56:06.228675 15681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.212162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:46575 (local address 127.12.73.131:36263)
0808 14:56:06.222746 (+ 10584us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:06.222762 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:06.222926 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:06.223374 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:06.223383 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:06.223409 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:06.223819 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:06.223832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.225158 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.225191 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:06.226668 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:06.226686 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.227768 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.227778 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:06.228016 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.228043 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 14:56:06.228161 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 14:56:06.228299 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10459,"mutex_wait_us":4,"thread_start_us":9682,"threads_started":1}
I20260808 14:56:06.228819 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.212620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:36263 (local address 127.12.73.130:46575)
0808 14:56:06.221671 (+ 9051us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:06.221681 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:06.222867 (+ 1186us) server_negotiation.cc:407] Connection header received
0808 14:56:06.223086 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:06.223090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:06.223158 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:06.223281 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:06.224047 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.224999 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.226828 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.227568 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.227774 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.227848 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:06.228349 (+ 501us) server_negotiation.cc:299] Negotiation successful
0808 14:56:06.228456 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8877,"thread_start_us":8758,"threads_started":1}
I20260808 14:56:06.229255 15012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab01e075add4427cafb585faa5f53f56" candidate_uuid: "0abbeacbb49b48ef851b60a936c5221e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2de62634d03440d9969b7ac12662edf4" is_pre_election: true
I20260808 14:56:06.229496 15261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab01e075add4427cafb585faa5f53f56" candidate_uuid: "0abbeacbb49b48ef851b60a936c5221e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" is_pre_election: true
I20260808 14:56:06.229619 15012 raft_consensus.cc:2454] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0abbeacbb49b48ef851b60a936c5221e in term 0.
I20260808 14:56:06.229823 15261 raft_consensus.cc:2454] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0abbeacbb49b48ef851b60a936c5221e in term 0.
I20260808 14:56:06.230168 15378 leader_election.cc:302] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0abbeacbb49b48ef851b60a936c5221e, 2de62634d03440d9969b7ac12662edf4; no voters:
I20260808 14:56:06.230546 15620 raft_consensus.cc:2781] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:06.230691 15620 raft_consensus.cc:482] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:06.230794 15620 raft_consensus.cc:3037] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:06.232870 15620 raft_consensus.cc:504] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:06.233530 15620 leader_election.cc:288] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [CANDIDATE]: Term 1 election: Requested vote from peers 2de62634d03440d9969b7ac12662edf4 (127.12.73.129:33945), 6cd7b3a0b39b4375b18ae8ba5cc44272 (127.12.73.130:46575)
I20260808 14:56:06.233978 15012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab01e075add4427cafb585faa5f53f56" candidate_uuid: "0abbeacbb49b48ef851b60a936c5221e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2de62634d03440d9969b7ac12662edf4"
I20260808 14:56:06.234074 15261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab01e075add4427cafb585faa5f53f56" candidate_uuid: "0abbeacbb49b48ef851b60a936c5221e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272"
I20260808 14:56:06.234191 15012 raft_consensus.cc:3037] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:06.234284 15261 raft_consensus.cc:3037] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:06.237197 15261 raft_consensus.cc:2454] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0abbeacbb49b48ef851b60a936c5221e in term 1.
I20260808 14:56:06.237215 15012 raft_consensus.cc:2454] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0abbeacbb49b48ef851b60a936c5221e in term 1.
I20260808 14:56:06.237655 15383 leader_election.cc:302] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0abbeacbb49b48ef851b60a936c5221e, 6cd7b3a0b39b4375b18ae8ba5cc44272; no voters:
I20260808 14:56:06.238019 15620 raft_consensus.cc:2781] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:06.238396 15620 raft_consensus.cc:686] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [term 1 LEADER]: Becoming Leader. State: Replica: 0abbeacbb49b48ef851b60a936c5221e, State: Running, Role: LEADER
I20260808 14:56:06.238754 15620 consensus_queue.cc:237] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } }
I20260808 14:56:06.240687 15688 tablet_replica.cc:439] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: TxnStatusTablet state changed. Reason: New leader 0abbeacbb49b48ef851b60a936c5221e. Latest consensus state: current_term: 1 leader_uuid: "0abbeacbb49b48ef851b60a936c5221e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } }
I20260808 14:56:06.241075 15688 tablet_replica.cc:442] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:56:06.241765 15690 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:56:06.242054 15690 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:56:06.242444 14693 catalog_manager.cc:5495] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0abbeacbb49b48ef851b60a936c5221e (127.12.73.131). New cstate: current_term: 1 leader_uuid: "0abbeacbb49b48ef851b60a936c5221e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } health_report { overall_health: HEALTHY } } }
I20260808 14:56:06.314738 15677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.308455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:38193 (local address 127.0.0.1:43798)
0808 14:56:06.308708 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:06.308730 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:06.308865 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:06.309648 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:06.309654 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:06.309668 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:56:06.309871 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:06.309882 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.310982 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.310988 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:06.312021 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:06.312033 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.312928 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.312934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:06.313137 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.313246 (+ 109us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:56:06.314170 (+ 924us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:56:06.314191 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 14:56:06.314278 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:56:06.314424 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 14:56:06.314812 15697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.308552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43798 (local address 127.12.73.131:38193)
0808 14:56:06.309204 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:06.309211 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:06.309241 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:56:06.309320 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:06.309323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:06.309421 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:06.309592 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:06.310026 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.310851 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.312176 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.312777 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.312924 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.313490 (+ 566us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:06.314016 (+ 526us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:06.314212 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:06.314317 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 14:56:06.314406 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":320,"threads_started":1}
I20260808 14:56:06.319778 15261 raft_consensus.cc:1261] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 1 FOLLOWER]: Refusing update from remote peer 0abbeacbb49b48ef851b60a936c5221e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:06.319952 15012 raft_consensus.cc:1261] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4 [term 1 FOLLOWER]: Refusing update from remote peer 0abbeacbb49b48ef851b60a936c5221e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:06.320641 15688 consensus_queue.cc:1035] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:06.320976 15620 consensus_queue.cc:1035] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:06.330044 15624 tablet_replica.cc:439] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4: TxnStatusTablet state changed. Reason: New leader 0abbeacbb49b48ef851b60a936c5221e. Latest consensus state: current_term: 1 leader_uuid: "0abbeacbb49b48ef851b60a936c5221e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } }
I20260808 14:56:06.330400 15624 tablet_replica.cc:442] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:06.333310 15698 mvcc.cc:205] Tried to move back new op lower bound from 7316279158038638592 to 7316279157717528576. Current Snapshot: MvccSnapshot[applied={T|T < 7316279158038638592}]
I20260808 14:56:06.334204 15700 mvcc.cc:205] Tried to move back new op lower bound from 7316279158038638592 to 7316279157717528576. Current Snapshot: MvccSnapshot[applied={T|T < 7316279158038638592}]
I20260808 14:56:06.334653 15627 tablet_replica.cc:439] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272: TxnStatusTablet state changed. Reason: New leader 0abbeacbb49b48ef851b60a936c5221e. Latest consensus state: current_term: 1 leader_uuid: "0abbeacbb49b48ef851b60a936c5221e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } }
I20260808 14:56:06.335001 15627 tablet_replica.cc:442] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:06.338441 15699 mvcc.cc:205] Tried to move back new op lower bound from 7316279158038638592 to 7316279157717528576. Current Snapshot: MvccSnapshot[applied={T|T < 7316279158038638592}]
I20260808 14:56:06.350260 15627 tablet_replica.cc:439] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0abbeacbb49b48ef851b60a936c5221e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } }
I20260808 14:56:06.350586 15627 tablet_replica.cc:442] T ab01e075add4427cafb585faa5f53f56 P 6cd7b3a0b39b4375b18ae8ba5cc44272: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:06.354044 15624 tablet_replica.cc:439] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0abbeacbb49b48ef851b60a936c5221e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } }
I20260808 14:56:06.354341 15624 tablet_replica.cc:442] T ab01e075add4427cafb585faa5f53f56 P 2de62634d03440d9969b7ac12662edf4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:06.357590 15688 tablet_replica.cc:439] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0abbeacbb49b48ef851b60a936c5221e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } }
I20260808 14:56:06.357874 15688 tablet_replica.cc:442] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:56:06.358114 15688 tablet_replica.cc:439] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0abbeacbb49b48ef851b60a936c5221e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2de62634d03440d9969b7ac12662edf4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 33945 } } peers { permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 } } peers { permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 } } }
I20260808 14:56:06.358311 15688 tablet_replica.cc:442] T ab01e075add4427cafb585faa5f53f56 P 0abbeacbb49b48ef851b60a936c5221e: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:56:06.372390 15697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.362900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:60687 (local address 127.12.73.131:38193)
0808 14:56:06.363068 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:06.363076 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:06.365865 (+ 2789us) server_negotiation.cc:407] Connection header received
0808 14:56:06.366062 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:06.366068 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:06.366149 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:06.366253 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:06.366878 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.368044 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.370255 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.370931 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.371055 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.371606 (+ 551us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:06.371753 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:06.371848 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:06.372009 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 14:56:06.372097 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:56:06.372568 15715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.362921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:38193 (local address 127.12.73.129:60687)
0808 14:56:06.365739 (+ 2818us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:06.365766 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:06.365926 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:06.366291 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:06.366296 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:06.366309 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:56:06.366709 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:06.366722 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.368194 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.368200 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:06.370080 (+ 1880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:06.370098 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.371124 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.371131 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:06.371318 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.371400 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:56:06.371872 (+ 472us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:56:06.371885 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 14:56:06.371978 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:56:06.372134 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2633,"thread_start_us":2462,"threads_started":1}
I20260808 14:56:06.385061 15499 raft_consensus.cc:1261] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e [term 1 FOLLOWER]: Refusing update from remote peer 2de62634d03440d9969b7ac12662edf4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:06.385694 15261 raft_consensus.cc:1261] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 1 FOLLOWER]: Refusing update from remote peer 2de62634d03440d9969b7ac12662edf4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:06.385736 15630 consensus_queue.cc:1035] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0abbeacbb49b48ef851b60a936c5221e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 38193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:06.386278 15630 consensus_queue.cc:1035] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd7b3a0b39b4375b18ae8ba5cc44272" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:06.430671 15682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.423199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:59977 (local address 127.12.73.129:33945)
0808 14:56:06.423408 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:06.423416 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:06.424133 (+ 717us) server_negotiation.cc:407] Connection header received
0808 14:56:06.424364 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:06.424370 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:06.424466 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:06.424560 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:06.425461 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.426490 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.428398 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.429036 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.429146 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.429893 (+ 747us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:06.430023 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:06.430092 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:06.430356 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 14:56:06.430443 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:56:06.431488 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.423290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:33945 (local address 127.12.73.131:59977)
0808 14:56:06.424024 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:06.424040 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:06.424206 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:06.424757 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:06.424762 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:06.424781 (+ 19us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:56:06.425252 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:06.425268 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.426640 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.426644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:06.428188 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:06.428219 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.429380 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.429386 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:06.429585 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.429659 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:56:06.430189 (+ 530us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:56:06.430202 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 14:56:06.430970 (+ 768us) client_negotiation.cc:240] Negotiation successful
0808 14:56:06.431121 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":369,"threads_started":1}
I20260808 14:56:06.472873 14693 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:06.473119 14693 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:06.476257 14693 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 567d4cc3de6e4c6d8087e62e0c2c3ff9: Sending DeleteTablet for 3 replicas of tablet 3fff3994bd4b4ce1860905b4e50ee7aa
I20260808 14:56:06.477109 14975 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fff3994bd4b4ce1860905b4e50ee7aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:06 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:53462
I20260808 14:56:06.477161 15211 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fff3994bd4b4ce1860905b4e50ee7aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:06 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:33636
I20260808 14:56:06.477684 15460 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fff3994bd4b4ce1860905b4e50ee7aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:06 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:43782
I20260808 14:56:06.477843 15724 tablet_replica.cc:330] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272: stopping tablet replica
I20260808 14:56:06.478032 15724 raft_consensus.cc:2229] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:06.478307 15724 raft_consensus.cc:2258] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:06.479596 15724 ts_tablet_manager.cc:1905] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:06.487375 15729 tablet_replica.cc:330] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e: stopping tablet replica
I20260808 14:56:06.487408 15724 ts_tablet_manager.cc:1918] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:56:06.487532 15724 log.cc:1196] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/3fff3994bd4b4ce1860905b4e50ee7aa
I20260808 14:56:06.487623 15729 raft_consensus.cc:2229] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:06.488001 15729 raft_consensus.cc:2258] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:06.488171 15724 ts_tablet_manager.cc:1939] T 3fff3994bd4b4ce1860905b4e50ee7aa P 6cd7b3a0b39b4375b18ae8ba5cc44272: Deleting consensus metadata
I20260808 14:56:06.489272 14669 catalog_manager.cc:4841] TS 6cd7b3a0b39b4375b18ae8ba5cc44272 (127.12.73.130:46575): tablet 3fff3994bd4b4ce1860905b4e50ee7aa (table test-table [id=0e00f9d69224491abf45c548d69dba92]) successfully deleted
I20260808 14:56:06.490868 15729 ts_tablet_manager.cc:1905] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:06.497592 15727 tablet_replica.cc:330] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4: stopping tablet replica
I20260808 14:56:06.497818 15727 raft_consensus.cc:2229] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:56:06.498175 15729 ts_tablet_manager.cc:1918] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:56:06.498214 15727 raft_consensus.cc:2258] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:06.498319 15729 log.cc:1196] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/3fff3994bd4b4ce1860905b4e50ee7aa
I20260808 14:56:06.498786 15729 ts_tablet_manager.cc:1939] T 3fff3994bd4b4ce1860905b4e50ee7aa P 0abbeacbb49b48ef851b60a936c5221e: Deleting consensus metadata
I20260808 14:56:06.499351 15727 ts_tablet_manager.cc:1905] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:06.499816 14664 catalog_manager.cc:4841] TS 0abbeacbb49b48ef851b60a936c5221e (127.12.73.131:38193): tablet 3fff3994bd4b4ce1860905b4e50ee7aa (table test-table [id=0e00f9d69224491abf45c548d69dba92]) successfully deleted
Aug 08 14:56:06 dist-test-slave-z8x9 krb5kdc[14610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200965, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:56:06.506016 15727 ts_tablet_manager.cc:1918] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:56:06.506173 15727 log.cc:1196] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/3fff3994bd4b4ce1860905b4e50ee7aa
I20260808 14:56:06.506639 15727 ts_tablet_manager.cc:1939] T 3fff3994bd4b4ce1860905b4e50ee7aa P 2de62634d03440d9969b7ac12662edf4: Deleting consensus metadata
I20260808 14:56:06.507838 14664 catalog_manager.cc:4841] TS 2de62634d03440d9969b7ac12662edf4 (127.12.73.129:33945): tablet 3fff3994bd4b4ce1860905b4e50ee7aa (table test-table [id=0e00f9d69224491abf45c548d69dba92]) successfully deleted
I20260808 14:56:06.511124 15682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.492977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53492 (local address 127.12.73.129:33945)
0808 14:56:06.493154 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:06.493161 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:06.493721 (+ 560us) server_negotiation.cc:407] Connection header received
0808 14:56:06.493895 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:06.493901 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:06.493981 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:06.494102 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:06.496027 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.497244 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.499172 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.499806 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.499951 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.504309 (+ 4358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:06.504321 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:06.504340 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:06.504376 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:06.508215 (+ 3839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:06.508912 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:06.508921 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:06.508924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:06.509084 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:06.509477 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:06.509484 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:06.509487 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:06.509907 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:06.510223 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:06.510552 (+ 329us) server_negotiation.cc:299] Negotiation successful
0808 14:56:06.510760 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 14:56:06.511930 15096 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53492
I20260808 14:56:06.532110 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.514946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48650 (local address 127.12.73.190:39493)
0808 14:56:06.517585 (+ 2639us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:06.517592 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:06.518018 (+ 426us) server_negotiation.cc:407] Connection header received
0808 14:56:06.518235 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:06.518243 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:06.518341 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:06.518446 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:06.520074 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.520807 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.522524 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.522913 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.523004 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.525994 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:06.526003 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:06.526010 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:06.526056 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:06.529080 (+ 3024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:06.529920 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:06.529924 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:06.529926 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:06.530048 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:06.530520 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:06.530525 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:06.530531 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:06.530884 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:06.531066 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:06.531528 (+ 462us) server_negotiation.cc:299] Negotiation successful
0808 14:56:06.531766 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2514,"thread_start_us":2398,"threads_started":1}
W20260808 14:56:06.532953 14693 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48650
I20260808 14:56:06.535491 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 14831
I20260808 14:56:06.560853 15682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.536343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53498 (local address 127.12.73.129:33945)
0808 14:56:06.536549 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:06.536555 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:06.548162 (+ 11607us) server_negotiation.cc:407] Connection header received
0808 14:56:06.548362 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:06.548366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:06.548452 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:06.548542 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:06.550257 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.550930 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.552721 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.553090 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.553273 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.555647 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:06.555652 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:06.555655 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:06.555686 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:06.558304 (+ 2618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:06.558943 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:06.558950 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:06.558953 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:06.559100 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:06.559474 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:06.559479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:06.559482 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:06.559741 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:06.559991 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:06.560312 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 14:56:06.560532 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 14:56:06.561470 15096 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53498
W20260808 14:56:06.562031 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 14831: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:56:06.562214 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 14831
I20260808 14:56:06.604532 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15113
Aug 08 14:56:06 dist-test-slave-z8x9 krb5kdc[14610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200965, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:56:06.620077 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.605402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33640 (local address 127.12.73.130:46575)
0808 14:56:06.605590 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:06.605596 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:06.605649 (+ 53us) server_negotiation.cc:407] Connection header received
0808 14:56:06.605875 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:06.605887 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:06.605965 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:06.606085 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:06.607389 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.608171 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.609581 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.610012 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.610170 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.614284 (+ 4114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:06.614298 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:06.614311 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:06.614344 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:06.617384 (+ 3040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:06.618047 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:06.618055 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:06.618057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:06.618198 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:06.618592 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:06.618596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:06.618598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:06.618930 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:06.619260 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:06.619493 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 14:56:06.619753 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260808 14:56:06.620795 15334 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33640
W20260808 14:56:06.621523 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15113: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:56:06.621723 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 15113
I20260808 14:56:06.659368 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15346
Aug 08 14:56:06 dist-test-slave-z8x9 krb5kdc[14610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200965, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:56:06.680922 15697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:06.660385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43802 (local address 127.12.73.131:38193)
0808 14:56:06.660728 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:06.660736 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:06.660758 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:56:06.660874 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:06.660882 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:06.660986 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:06.661119 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:06.663054 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.664366 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.666377 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:06.667094 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:06.667207 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:06.673347 (+ 6140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:06.673369 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:06.673394 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:06.673453 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:06.677866 (+ 4413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:06.678558 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:06.678568 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:06.678572 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:06.678768 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:06.679142 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:06.679147 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:06.679150 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:06.679697 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:06.680037 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:06.680250 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 14:56:06.680504 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
W20260808 14:56:06.681697 15582 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43802
W20260808 14:56:06.682471 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15346: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:56:06.682636 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 15346
I20260808 14:56:06.710901 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 14631
I20260808 14:56:06.712085 14768 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:06.829618 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 14631
2026-08-08T14:56:06Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5050 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:56:06 dist-test-slave-z8x9 krb5kdc[15747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:56:06 dist-test-slave-z8x9 krb5kdc[15747](info): set up 2 sockets
Aug 08 14:56:06 dist-test-slave-z8x9 krb5kdc[15747](info): commencing operation
krb5kdc: starting...
W20260808 14:56:08.156215 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.000s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:56:08 dist-test-slave-z8x9 krb5kdc[15747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:56:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:56:08.364979 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34785
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:34785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:08.691195 15766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:08.691488 15766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:08.691579 15766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:08.698673 15766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:08.698776 15766 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:56:08.698830 15766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:08.698890 15766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:08.698939 15766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:08.698994 15766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:08.708425 15766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:34785
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:08.709638 15766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:08.710889 15766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:08.723507 15775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:08.723584 15777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:08.723560 15774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:08.724579 15766 server_base.cc:1034] running on GCE node
I20260808 14:56:08.725426 15766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:08.726758 15766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:08.727970 15766 hybrid_clock.cc:648] HybridClock initialized: now 1786200968727911 us; error 31 us; skew 500 ppm
I20260808 14:56:08.728299 15766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:08 dist-test-slave-z8x9 krb5kdc[15747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200968, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:08.731482 15766 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:56:08.732925 15766 webserver.cc:460] Webserver started at http://127.12.73.190:45463/ using document root <none> and password file <none>
I20260808 14:56:08.733685 15766 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:08.733819 15766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:08.734138 15766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:08.736995 15766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "0c7ad3585003406f9eafb6bf5314497f"
format_stamp: "Formatted at 2026-08-08 14:56:08 on dist-test-slave-z8x9"
server_key: "d0e9e95a9ac2b52aa2d64707de4e4139"
server_key_iv: "e41fa9b9ba6482fc20899ade1d844050"
server_key_version: "encryptionkey@0"
I20260808 14:56:08.737879 15766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "0c7ad3585003406f9eafb6bf5314497f"
format_stamp: "Formatted at 2026-08-08 14:56:08 on dist-test-slave-z8x9"
server_key: "d0e9e95a9ac2b52aa2d64707de4e4139"
server_key_iv: "e41fa9b9ba6482fc20899ade1d844050"
server_key_version: "encryptionkey@0"
I20260808 14:56:08.742833 15766 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:56:08.746127 15787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:08.747370 15766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:56:08.747555 15766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "0c7ad3585003406f9eafb6bf5314497f"
format_stamp: "Formatted at 2026-08-08 14:56:08 on dist-test-slave-z8x9"
server_key: "d0e9e95a9ac2b52aa2d64707de4e4139"
server_key_iv: "e41fa9b9ba6482fc20899ade1d844050"
server_key_version: "encryptionkey@0"
I20260808 14:56:08.747766 15766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:08.765748 15766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:08.769641 15766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:08.769919 15766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:08.792176 15766 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:34785
I20260808 14:56:08.792212 15892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:34785 every 8 connection(s)
I20260808 14:56:08.793552 15766 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:08.794516 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 15766
I20260808 14:56:08.794731 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:08.795579 12582 external_mini_cluster.cc:1428] Setting key fac3c370b0e89f0088fc6d2df4646b13
I20260808 14:56:08.798511 15894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 14:56:08 dist-test-slave-z8x9 krb5kdc[15747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:08.809064 15894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f: Bootstrap starting.
I20260808 14:56:08.813501 15894 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:08.814905 15894 log.cc:824] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:08.818397 15894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f: No bootstrap required, opened a new log
I20260808 14:56:08.819497 15899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:08.797769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44178 (local address 127.12.73.190:34785)
0808 14:56:08.798537 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:08.798547 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:08.798621 (+ 74us) server_negotiation.cc:407] Connection header received
0808 14:56:08.800174 (+ 1553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:08.800193 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:08.800538 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:08.800932 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:08.802366 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:08.803716 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:08.804962 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:08.805666 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:08.805894 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:08.810321 (+ 4427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:08.810331 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:08.810349 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:08.810392 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:08.814698 (+ 4306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:08.815559 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:08.815567 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:08.815577 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:08.815775 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:08.816309 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:08.816314 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:08.816317 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:08.816993 (+ 676us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:08.817357 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:08.817746 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 14:56:08.818192 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":367,"threads_started":1}
I20260808 14:56:08.826920 15894 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7ad3585003406f9eafb6bf5314497f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34785 } }
I20260808 14:56:08.827244 15894 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:08.827322 15894 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7ad3585003406f9eafb6bf5314497f, State: Initialized, Role: FOLLOWER
I20260808 14:56:08.827860 15894 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7ad3585003406f9eafb6bf5314497f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34785 } }
I20260808 14:56:08.828063 15894 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:08.828161 15894 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:08.828285 15894 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:08.830776 15894 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7ad3585003406f9eafb6bf5314497f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34785 } }
I20260808 14:56:08.831234 15894 leader_election.cc:302] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c7ad3585003406f9eafb6bf5314497f; no voters:
I20260808 14:56:08.831751 15894 leader_election.cc:288] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:08.831900 15904 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:08.832636 15904 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [term 1 LEADER]: Becoming Leader. State: Replica: 0c7ad3585003406f9eafb6bf5314497f, State: Running, Role: LEADER
I20260808 14:56:08.833142 15904 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7ad3585003406f9eafb6bf5314497f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34785 } }
I20260808 14:56:08.833871 15894 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:08.836063 15906 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c7ad3585003406f9eafb6bf5314497f. Latest consensus state: current_term: 1 leader_uuid: "0c7ad3585003406f9eafb6bf5314497f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7ad3585003406f9eafb6bf5314497f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34785 } } }
I20260808 14:56:08.836422 15906 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:08.837452 15905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c7ad3585003406f9eafb6bf5314497f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7ad3585003406f9eafb6bf5314497f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34785 } } }
I20260808 14:56:08.837842 15905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:08.840071 15911 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:08.845280 15911 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:08.854892 15911 catalog_manager.cc:1347] Generated new cluster ID: 1a0656e10d244a269398c651bba9921e
I20260808 14:56:08.855031 15911 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:08.870568 15911 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:08.871974 15911 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:08.884004 15911 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f: Generated new TSK 0
I20260808 14:56:08.884897 15911 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:56:08.949221 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34785
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:09.283313 15942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:09.283584 15942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:09.283798 15942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:09.291545 15942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:09.291651 15942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:09.291821 15942 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:56:09.291913 15942 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:56:09.292024 15942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:56:09.301744 15942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.73.190:34785
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:09.303031 15942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:09.304375 15942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:09.318059 15958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:09.318323 15955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:09.318547 15952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:09.318976 15942 server_base.cc:1034] running on GCE node
I20260808 14:56:09.319577 15942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:09.320523 15942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:09.321730 15942 hybrid_clock.cc:648] HybridClock initialized: now 1786200969321667 us; error 49 us; skew 500 ppm
I20260808 14:56:09.322062 15942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:09 dist-test-slave-z8x9 krb5kdc[15747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200969, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:09.330046 15942 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:56:09.331635 15942 webserver.cc:460] Webserver started at http://127.12.73.129:37303/ using document root <none> and password file <none>
I20260808 14:56:09.332347 15942 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:09.332500 15942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:09.332826 15942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:09.336027 15942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "41d3f4a2875c46e0b769e124d55ca6e0"
format_stamp: "Formatted at 2026-08-08 14:56:09 on dist-test-slave-z8x9"
server_key: "88581f6d8cd640273290911fae513ac2"
server_key_iv: "20f51cf4d6d165d6d539c62d9c7594b0"
server_key_version: "encryptionkey@0"
I20260808 14:56:09.336807 15942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "41d3f4a2875c46e0b769e124d55ca6e0"
format_stamp: "Formatted at 2026-08-08 14:56:09 on dist-test-slave-z8x9"
server_key: "88581f6d8cd640273290911fae513ac2"
server_key_iv: "20f51cf4d6d165d6d539c62d9c7594b0"
server_key_version: "encryptionkey@0"
I20260808 14:56:09.342263 15942 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 14:56:09.345899 15970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:09.347290 15942 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:56:09.347465 15942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "41d3f4a2875c46e0b769e124d55ca6e0"
format_stamp: "Formatted at 2026-08-08 14:56:09 on dist-test-slave-z8x9"
server_key: "88581f6d8cd640273290911fae513ac2"
server_key_iv: "20f51cf4d6d165d6d539c62d9c7594b0"
server_key_version: "encryptionkey@0"
I20260808 14:56:09.347641 15942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:09.376057 15942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:09.380129 15942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:09.380441 15942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:09.383242 15942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:09.383389 15942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:09.383548 15942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:09.383652 15942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:56:09 dist-test-slave-z8x9 krb5kdc[15747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200969, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:09.407485 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:09.384038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:40255 (local address 127.12.73.190:34785)
0808 14:56:09.384624 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:09.384631 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:09.385811 (+ 1180us) server_negotiation.cc:407] Connection header received
0808 14:56:09.388997 (+ 3186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:09.389005 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:09.389118 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:09.389265 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:09.390784 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.392078 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.394819 (+ 2741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.395332 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.395486 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:09.400120 (+ 4634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:09.400125 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:09.400128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:09.400167 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:09.403590 (+ 3423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:09.404604 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:09.404609 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:09.404611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:09.404739 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:09.405315 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:09.405320 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:09.405324 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:09.405632 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:09.405816 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:09.407009 (+ 1193us) server_negotiation.cc:299] Negotiation successful
0808 14:56:09.407187 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":328,"threads_started":1}
I20260808 14:56:09.409698 15984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:09.384678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34785 (local address 127.12.73.129:40255)
0808 14:56:09.385605 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:09.385678 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:09.388498 (+ 2820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:09.389494 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:09.389502 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:09.390016 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:09.390597 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:09.390614 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.392283 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.392292 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:09.394659 (+ 2367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:09.394673 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.395632 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.395643 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:09.396023 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:09.396917 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:09.396940 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:09.399876 (+ 2936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:09.403750 (+ 3874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:09.403762 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:09.403777 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:09.404430 (+ 653us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:09.404858 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:09.404863 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:09.404868 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:09.405105 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:09.405816 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:09.405824 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:09.406475 (+ 651us) client_negotiation.cc:769] Sending connection context
0808 14:56:09.406909 (+ 434us) client_negotiation.cc:240] Negotiation successful
0808 14:56:09.407665 (+ 756us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":389,"threads_started":1}
I20260808 14:56:09.431486 15942 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:45529
I20260808 14:56:09.431527 16183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:45529 every 8 connection(s)
I20260808 14:56:09.432881 15942 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:56:09.433566 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:09.417866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:36023 (local address 127.12.73.190:34785)
0808 14:56:09.418102 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:09.418111 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:09.418691 (+ 580us) server_negotiation.cc:407] Connection header received
0808 14:56:09.419024 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:09.419032 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:09.419114 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:09.419233 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:09.420786 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.421738 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.423874 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.424480 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.424618 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:09.427460 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:09.427465 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:09.427468 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:09.427497 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:09.430318 (+ 2821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:09.431381 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:09.431387 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:09.431391 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:09.431610 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:09.431998 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:09.432004 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:09.432007 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:09.432293 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:09.432454 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:09.432879 (+ 425us) server_negotiation.cc:299] Negotiation successful
0808 14:56:09.433115 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 14:56:09.433686 16125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:09.417821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34785 (local address 127.12.73.129:36023)
0808 14:56:09.418574 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:09.418602 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:09.418834 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:09.419271 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:09.419276 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:09.420093 (+ 817us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:09.420629 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:09.420642 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.421929 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.421943 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:09.423642 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:09.423658 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.424866 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.424870 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:09.425143 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:09.426053 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:09.426090 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:09.427256 (+ 1166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:09.430483 (+ 3227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:09.430488 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:09.430491 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:09.431247 (+ 756us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:09.431732 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:09.431737 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:09.431741 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:09.431884 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:09.432428 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:09.432433 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:09.432617 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 14:56:09.432783 (+ 166us) client_negotiation.cc:240] Negotiation successful
0808 14:56:09.433148 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":378,"threads_started":1}
I20260808 14:56:09.435251 16185 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34785
I20260808 14:56:09.435536 16185 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:09.436256 16185 heartbeater.cc:511] Master 127.12.73.190:34785 requested a full tablet report, sending...
I20260808 14:56:09.438669 15813 ts_manager.cc:194] Registered new tserver with Master: 41d3f4a2875c46e0b769e124d55ca6e0 (127.12.73.129:45529)
I20260808 14:56:09.440116 15813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:40255
I20260808 14:56:09.442073 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 15942
I20260808 14:56:09.442314 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:56:09.442966 12582 external_mini_cluster.cc:1428] Setting key a2723547a6fc6a0d18babb35847b10e8
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:56:09.489326 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34785
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:09.819299 16193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:09.819628 16193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:09.819831 16193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:09.827250 16193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:09.827415 16193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:09.827587 16193 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:56:09.827685 16193 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:56:09.827796 16193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:56:09.838429 16193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.73.190:34785
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:09.839742 16193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:09.841279 16193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:09.855047 16203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:09.855135 16201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:09.855124 16200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:09.855834 16193 server_base.cc:1034] running on GCE node
I20260808 14:56:09.856474 16193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:09.857473 16193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:09.858700 16193 hybrid_clock.cc:648] HybridClock initialized: now 1786200969858648 us; error 57 us; skew 500 ppm
I20260808 14:56:09.859016 16193 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:09 dist-test-slave-z8x9 krb5kdc[15747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200969, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:09.862200 16193 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:56:09.863616 16193 webserver.cc:460] Webserver started at http://127.12.73.130:44515/ using document root <none> and password file <none>
I20260808 14:56:09.864292 16193 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:09.864441 16193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:09.864769 16193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:09.867723 16193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "74042c3f756e48fd84df43b5212bfa8d"
format_stamp: "Formatted at 2026-08-08 14:56:09 on dist-test-slave-z8x9"
server_key: "c3ec8297e355dce08e6d5aacdd1aa31d"
server_key_iv: "d37c62148ab4fe267bfa1ed0f27aa581"
server_key_version: "encryptionkey@0"
I20260808 14:56:09.868505 16193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "74042c3f756e48fd84df43b5212bfa8d"
format_stamp: "Formatted at 2026-08-08 14:56:09 on dist-test-slave-z8x9"
server_key: "c3ec8297e355dce08e6d5aacdd1aa31d"
server_key_iv: "d37c62148ab4fe267bfa1ed0f27aa581"
server_key_version: "encryptionkey@0"
I20260808 14:56:09.873617 16193 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 14:56:09.876955 16212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:09.878269 16193 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:09.878448 16193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "74042c3f756e48fd84df43b5212bfa8d"
format_stamp: "Formatted at 2026-08-08 14:56:09 on dist-test-slave-z8x9"
server_key: "c3ec8297e355dce08e6d5aacdd1aa31d"
server_key_iv: "d37c62148ab4fe267bfa1ed0f27aa581"
server_key_version: "encryptionkey@0"
I20260808 14:56:09.878640 16193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:09.909812 16193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:09.914413 16193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:09.914721 16193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:09.917487 16193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:09.917619 16193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:09.917742 16193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:09.917840 16193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:56:09 dist-test-slave-z8x9 krb5kdc[15747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200969, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:09.941550 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:09.918160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:37473 (local address 127.12.73.190:34785)
0808 14:56:09.918378 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:09.918386 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:09.919879 (+ 1493us) server_negotiation.cc:407] Connection header received
0808 14:56:09.921970 (+ 2091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:09.921976 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:09.922070 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:09.922192 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:09.924234 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.925284 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.927859 (+ 2575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.928717 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.928858 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:09.933778 (+ 4920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:09.933784 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:09.933788 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:09.933842 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:09.937513 (+ 3671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:09.938613 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:09.938622 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:09.938627 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:09.938797 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:09.939401 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:09.939409 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:09.939414 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:09.939745 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:09.939930 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:09.940896 (+ 966us) server_negotiation.cc:299] Negotiation successful
0808 14:56:09.941143 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:56:09.942595 16231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:09.918858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34785 (local address 127.12.73.130:37473)
0808 14:56:09.919708 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:09.919752 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:09.921648 (+ 1896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:09.922422 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:09.922430 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:09.923214 (+ 784us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:09.924047 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:09.924066 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.925508 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.925513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:09.927681 (+ 2168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:09.927702 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.928941 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.928946 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:09.929126 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:09.929989 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:09.930029 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:09.933533 (+ 3504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:09.937725 (+ 4192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:09.937738 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:09.937759 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:09.938472 (+ 713us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:09.938970 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:09.938974 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:09.938977 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:09.939176 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:09.939892 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:09.939905 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:09.940404 (+ 499us) client_negotiation.cc:769] Sending connection context
0808 14:56:09.940784 (+ 380us) client_negotiation.cc:240] Negotiation successful
0808 14:56:09.941379 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":392,"threads_started":1}
I20260808 14:56:09.965418 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:09.949239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:37501 (local address 127.12.73.190:34785)
0808 14:56:09.949463 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:09.949471 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:09.950296 (+ 825us) server_negotiation.cc:407] Connection header received
0808 14:56:09.950482 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:09.950485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:09.950597 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:09.950714 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:09.951874 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.953375 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.954713 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.955421 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.955578 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:09.958295 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:09.958305 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:09.958313 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:09.958365 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:09.961729 (+ 3364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:09.962654 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:09.962658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:09.962660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:09.962788 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:09.963311 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:09.963318 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:09.963321 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:09.963795 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:09.963961 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:09.964843 (+ 882us) server_negotiation.cc:299] Negotiation successful
0808 14:56:09.965095 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:56:09.965541 16358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:09.949267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34785 (local address 127.12.73.130:37501)
0808 14:56:09.950167 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:09.950197 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:09.950364 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:09.950790 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:09.950795 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:09.951332 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:09.951623 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:09.951631 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.953544 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.953549 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:09.954568 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:09.954580 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:09.955643 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:09.955652 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:09.955891 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:09.956805 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:09.956830 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:09.958064 (+ 1234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:09.961867 (+ 3803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:09.961875 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:09.961879 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:09.962473 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:09.962965 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:09.962971 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:09.962978 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:09.963170 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:09.963937 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:09.963941 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:09.964201 (+ 260us) client_negotiation.cc:769] Sending connection context
0808 14:56:09.964409 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 14:56:09.964819 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"thread_start_us":489,"threads_started":1}
I20260808 14:56:09.973582 16193 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:42735
I20260808 14:56:09.973616 16435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:42735 every 8 connection(s)
I20260808 14:56:09.974848 16193 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:56:09.977250 16438 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34785
I20260808 14:56:09.977504 16438 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:09.978147 16438 heartbeater.cc:511] Master 127.12.73.190:34785 requested a full tablet report, sending...
I20260808 14:56:09.979504 15813 ts_manager.cc:194] Registered new tserver with Master: 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735)
I20260808 14:56:09.980334 15813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:37473
I20260808 14:56:09.980436 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 16193
I20260808 14:56:09.980669 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:56:09.981138 12582 external_mini_cluster.cc:1428] Setting key e9c6a8bdc97ff6caa4477086f7308937
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:56:10.028990 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34785
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:10.360234 16442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:10.360534 16442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:10.360639 16442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:10.367976 16442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:10.368083 16442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:10.368170 16442 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:56:10.368223 16442 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:56:10.368290 16442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:56:10.378363 16442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.73.190:34785
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:10.379576 16442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:10.380803 16442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:10.397503 16447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:10.397622 16455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:10.397643 16452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:10.399300 16442 server_base.cc:1034] running on GCE node
I20260808 14:56:10.399989 16442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:10.400993 16442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:10.402241 16442 hybrid_clock.cc:648] HybridClock initialized: now 1786200970402193 us; error 61 us; skew 500 ppm
I20260808 14:56:10.402588 16442 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:10 dist-test-slave-z8x9 krb5kdc[15747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200970, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:10.405930 16442 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:56:10.407385 16442 webserver.cc:460] Webserver started at http://127.12.73.131:36711/ using document root <none> and password file <none>
I20260808 14:56:10.408131 16442 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:10.408286 16442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:10.408617 16442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:10.411576 16442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b"
format_stamp: "Formatted at 2026-08-08 14:56:10 on dist-test-slave-z8x9"
server_key: "fa871272d3afd1dd4284d02b4ac1b070"
server_key_iv: "eca5d8efc54545d2bc657d453d9113ab"
server_key_version: "encryptionkey@0"
I20260808 14:56:10.412501 16442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b"
format_stamp: "Formatted at 2026-08-08 14:56:10 on dist-test-slave-z8x9"
server_key: "fa871272d3afd1dd4284d02b4ac1b070"
server_key_iv: "eca5d8efc54545d2bc657d453d9113ab"
server_key_version: "encryptionkey@0"
I20260808 14:56:10.417945 16442 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260808 14:56:10.421481 16463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:10.422706 16442 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 14:56:10.422895 16442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b"
format_stamp: "Formatted at 2026-08-08 14:56:10 on dist-test-slave-z8x9"
server_key: "fa871272d3afd1dd4284d02b4ac1b070"
server_key_iv: "eca5d8efc54545d2bc657d453d9113ab"
server_key_version: "encryptionkey@0"
I20260808 14:56:10.423103 16442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:10.442941 16185 heartbeater.cc:503] Master 127.12.73.190:34785 was elected leader, sending a full tablet report...
I20260808 14:56:10.447954 16442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:10.452236 16442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:10.452553 16442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:10.455297 16442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:10.455427 16442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:10.455544 16442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:10.455646 16442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:56:10 dist-test-slave-z8x9 krb5kdc[15747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200970, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:10.479395 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.455967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:57525 (local address 127.12.73.190:34785)
0808 14:56:10.456179 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:10.456185 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:10.457635 (+ 1450us) server_negotiation.cc:407] Connection header received
0808 14:56:10.459683 (+ 2048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:10.459688 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:10.459782 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:10.459900 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:10.462039 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.463404 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.466000 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.466395 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.466545 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.471923 (+ 5378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:10.471928 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:10.471931 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:10.471971 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:10.475326 (+ 3355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:10.476380 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:10.476387 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:10.476390 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:10.476616 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:10.477096 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:10.477101 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:10.477105 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:10.477606 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:10.477811 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:10.478780 (+ 969us) server_negotiation.cc:299] Negotiation successful
0808 14:56:10.479006 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 14:56:10.480384 16477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.456617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34785 (local address 127.12.73.131:57525)
0808 14:56:10.457477 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:10.457516 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:10.459397 (+ 1881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:10.460129 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:10.460141 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:10.460901 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:10.461739 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.461762 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.463589 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.463597 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.465793 (+ 2196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.465810 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.466767 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.466778 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.466971 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.467776 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:10.467798 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:10.471657 (+ 3859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:10.475479 (+ 3822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:10.475488 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:10.475502 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:10.476197 (+ 695us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:10.476744 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:10.476747 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:10.476749 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:10.476957 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:10.477750 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:10.477763 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:10.478339 (+ 576us) client_negotiation.cc:769] Sending connection context
0808 14:56:10.478658 (+ 319us) client_negotiation.cc:240] Negotiation successful
0808 14:56:10.479196 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":339,"threads_started":1}
I20260808 14:56:10.500636 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.486737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:32879 (local address 127.12.73.190:34785)
0808 14:56:10.486885 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:10.486889 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:10.487594 (+ 705us) server_negotiation.cc:407] Connection header received
0808 14:56:10.487787 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:10.487792 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:10.487898 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:10.488008 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:10.489896 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.490921 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.492849 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.493320 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.493461 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.495216 (+ 1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:10.495222 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:10.495227 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:10.495266 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:10.497972 (+ 2706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:10.498637 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:10.498643 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:10.498646 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:10.498782 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:10.499156 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:10.499161 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:10.499164 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:10.499432 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:10.499622 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:10.500044 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 14:56:10.500263 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:56:10.501065 16572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.486863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34785 (local address 127.12.73.131:32879)
0808 14:56:10.487485 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:10.487505 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:10.487665 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:10.488071 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:10.488077 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:10.488952 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:10.489661 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.489681 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.491060 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.491065 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.492698 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.492709 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.493532 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.493538 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.493697 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.494322 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:10.494345 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:10.495033 (+ 688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:10.498104 (+ 3071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:10.498110 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:10.498114 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:10.498512 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:10.498900 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:10.498905 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:10.498908 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:10.499038 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:10.499581 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:10.499585 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:10.499788 (+ 203us) client_negotiation.cc:769] Sending connection context
0808 14:56:10.499958 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 14:56:10.500297 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":353,"threads_started":1}
I20260808 14:56:10.513816 16442 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:45361
I20260808 14:56:10.513855 16653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:45361 every 8 connection(s)
I20260808 14:56:10.515216 16442 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:56:10.517282 16660 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34785
I20260808 14:56:10.517527 16660 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:10.518136 16660 heartbeater.cc:511] Master 127.12.73.190:34785 requested a full tablet report, sending...
I20260808 14:56:10.519419 15813 ts_manager.cc:194] Registered new tserver with Master: cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361)
I20260808 14:56:10.520217 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 16442
I20260808 14:56:10.520238 15813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:57525
I20260808 14:56:10.520413 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:56:10.521056 12582 external_mini_cluster.cc:1428] Setting key d0ad3858f985fbf768aefa0160eb9a5a
I20260808 14:56:10.524117 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:56:10 dist-test-slave-z8x9 krb5kdc[15747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:56:10 dist-test-slave-z8x9 krb5kdc[15747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:10.578052 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.564257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44180 (local address 127.12.73.190:34785)
0808 14:56:10.564534 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:10.564542 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:10.564847 (+ 305us) server_negotiation.cc:407] Connection header received
0808 14:56:10.564997 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:10.565001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:10.565066 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:10.565150 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:10.566640 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.567372 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.568535 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.568973 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.569063 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.573001 (+ 3938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:10.573006 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:10.573009 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:10.573040 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:10.575511 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:10.576135 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:10.576138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:10.576141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:10.576260 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:10.576645 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:10.576648 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:10.576650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:10.576896 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:10.577080 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:10.577424 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 14:56:10.577592 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260808 14:56:10.582237 15813 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44180:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:56:10.589054 15813 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:10.615283 16680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.601197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42106 (local address 127.12.73.130:42735)
0808 14:56:10.601806 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:10.601815 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:10.606400 (+ 4585us) server_negotiation.cc:407] Connection header received
0808 14:56:10.606810 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:10.606817 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:10.607043 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:10.607216 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:10.608822 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.610136 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.613111 (+ 2975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.614178 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.614337 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.614541 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:10.614813 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 14:56:10.614968 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":567,"threads_started":1}
I20260808 14:56:10.615399 16679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.601118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:42735 (local address 127.0.0.1:42106)
0808 14:56:10.606251 (+ 5133us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:10.606283 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:10.606555 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:10.607504 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:10.607514 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:10.607546 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:10.608666 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.608680 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.610295 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.610301 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.612949 (+ 2648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.612964 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.614367 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.614373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.614557 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.614616 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 14:56:10.614749 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 14:56:10.614923 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5001,"mutex_wait_us":582,"spinlock_wait_cycles":3840,"thread_start_us":4875,"threads_started":1}
I20260808 14:56:10.616305 16683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.606663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:45529 (local address 127.0.0.1:53934)
0808 14:56:10.608591 (+ 1928us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:10.608612 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:10.608748 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:10.609545 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:10.609550 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:10.609574 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:10.609913 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.609923 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.611297 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.611303 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.613448 (+ 2145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.613462 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.615421 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.615429 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.615625 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.615653 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 14:56:10.615765 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 14:56:10.615905 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1797,"mutex_wait_us":22,"thread_start_us":1637,"threads_started":1}
I20260808 14:56:10.616555 16682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.601637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53182 (local address 127.12.73.131:45361)
0808 14:56:10.605802 (+ 4165us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:10.605812 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:10.606400 (+ 588us) server_negotiation.cc:407] Connection header received
0808 14:56:10.606798 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:10.606807 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:10.607057 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:10.607212 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:10.608356 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.610051 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.613309 (+ 3258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.614747 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.614876 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.615100 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:10.616023 (+ 923us) server_negotiation.cc:299] Negotiation successful
0808 14:56:10.616180 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3989,"thread_start_us":3792,"threads_started":1}
I20260808 14:56:10.617192 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.606941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53934 (local address 127.12.73.129:45529)
0808 14:56:10.608229 (+ 1288us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:10.608238 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:10.608716 (+ 478us) server_negotiation.cc:407] Connection header received
0808 14:56:10.608945 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:10.608953 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:10.609207 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:10.609385 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:10.610135 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.611142 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.613581 (+ 2439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.614947 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.615083 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.615270 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:10.616639 (+ 1369us) server_negotiation.cc:299] Negotiation successful
0808 14:56:10.616844 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1114,"thread_start_us":957,"threads_started":1}
I20260808 14:56:10.617601 16681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.601095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:45361 (local address 127.0.0.1:53182)
0808 14:56:10.606226 (+ 5131us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:10.606283 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:10.606555 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:10.607599 (+ 1044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:10.607604 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:10.607629 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:10.608075 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.608090 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.610172 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.610177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.613141 (+ 2964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.613153 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.615261 (+ 2108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.615268 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.615832 (+ 564us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.615862 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 14:56:10.617042 (+ 1180us) client_negotiation.cc:240] Negotiation successful
0808 14:56:10.617219 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4820,"mutex_wait_us":123,"thread_start_us":4648,"threads_started":1}
I20260808 14:56:10.619274 16302 tablet_service.cc:1467] Processing CreateTablet for tablet 68d478cd880144f58c7fe03af909612c (DEFAULT_TABLE table=test-table [id=579425f4d94d4e13bfa8be3170a1c4c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:10.620707 16302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68d478cd880144f58c7fe03af909612c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:10.620476 16060 tablet_service.cc:1467] Processing CreateTablet for tablet 68d478cd880144f58c7fe03af909612c (DEFAULT_TABLE table=test-table [id=579425f4d94d4e13bfa8be3170a1c4c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:10.620965 16542 tablet_service.cc:1467] Processing CreateTablet for tablet 68d478cd880144f58c7fe03af909612c (DEFAULT_TABLE table=test-table [id=579425f4d94d4e13bfa8be3170a1c4c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:10.621863 16060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68d478cd880144f58c7fe03af909612c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:10.622346 16542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68d478cd880144f58c7fe03af909612c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:10.633867 16685 tablet_bootstrap.cc:492] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d: Bootstrap starting.
I20260808 14:56:10.636579 16686 tablet_bootstrap.cc:492] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0: Bootstrap starting.
I20260808 14:56:10.637435 16685 tablet_bootstrap.cc:654] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:10.637656 16688 tablet_bootstrap.cc:492] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b: Bootstrap starting.
I20260808 14:56:10.638876 16685 log.cc:824] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:10.640250 16686 tablet_bootstrap.cc:654] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:10.640942 16688 tablet_bootstrap.cc:654] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:10.641865 16686 log.cc:824] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:10.642120 16688 log.cc:824] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:10.644914 16686 tablet_bootstrap.cc:492] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0: No bootstrap required, opened a new log
I20260808 14:56:10.645081 16688 tablet_bootstrap.cc:492] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b: No bootstrap required, opened a new log
I20260808 14:56:10.645216 16686 ts_tablet_manager.cc:1397] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 14:56:10.645411 16688 ts_tablet_manager.cc:1397] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.003s
I20260808 14:56:10.650206 16685 tablet_bootstrap.cc:492] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d: No bootstrap required, opened a new log
I20260808 14:56:10.650506 16685 ts_tablet_manager.cc:1397] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.006s
I20260808 14:56:10.653798 16688 raft_consensus.cc:348] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } }
I20260808 14:56:10.654146 16688 raft_consensus.cc:374] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:10.654258 16688 raft_consensus.cc:729] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacd24a79ccd4dc19ca6dfe97bf6883b, State: Initialized, Role: FOLLOWER
I20260808 14:56:10.654717 16686 raft_consensus.cc:348] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } }
I20260808 14:56:10.654881 16688 consensus_queue.cc:260] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } }
I20260808 14:56:10.655124 16686 raft_consensus.cc:374] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:10.655213 16686 raft_consensus.cc:729] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41d3f4a2875c46e0b769e124d55ca6e0, State: Initialized, Role: FOLLOWER
I20260808 14:56:10.655745 16686 consensus_queue.cc:260] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } }
I20260808 14:56:10.657627 16686 ts_tablet_manager.cc:1428] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0: Time spent starting tablet: real 0.012s user 0.006s sys 0.006s
I20260808 14:56:10.658535 16660 heartbeater.cc:503] Master 127.12.73.190:34785 was elected leader, sending a full tablet report...
I20260808 14:56:10.660925 16688 ts_tablet_manager.cc:1428] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260808 14:56:10.661036 16685 raft_consensus.cc:348] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } }
I20260808 14:56:10.661726 16685 raft_consensus.cc:374] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:10.661840 16685 raft_consensus.cc:729] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74042c3f756e48fd84df43b5212bfa8d, State: Initialized, Role: FOLLOWER
I20260808 14:56:10.662528 16685 consensus_queue.cc:260] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } }
I20260808 14:56:10.665256 16438 heartbeater.cc:503] Master 127.12.73.190:34785 was elected leader, sending a full tablet report...
I20260808 14:56:10.665827 16685 ts_tablet_manager.cc:1428] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
W20260808 14:56:10.685781 16189 tablet.cc:2369] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:56:10.719805 16696 raft_consensus.cc:482] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:10.720100 16696 raft_consensus.cc:504] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } }
I20260808 14:56:10.721760 16696 leader_election.cc:288] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361), 41d3f4a2875c46e0b769e124d55ca6e0 (127.12.73.129:45529)
W20260808 14:56:10.726917 16439 tablet.cc:2369] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:56:10.729087 16697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.722158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:45361 (local address 127.12.73.130:34145)
0808 14:56:10.722815 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:10.722839 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:10.723001 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:10.723607 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:10.723615 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:10.723648 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:10.724047 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.724069 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.725229 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.725235 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.727121 (+ 1886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.727135 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.728511 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.728515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.728628 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.728651 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:56:10.728723 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:56:10.728805 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"mutex_wait_us":1,"thread_start_us":345,"threads_started":1}
I20260808 14:56:10.729223 16682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.722251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:34145 (local address 127.12.73.131:45361)
0808 14:56:10.722527 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:10.722534 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:10.722949 (+ 415us) server_negotiation.cc:407] Connection header received
0808 14:56:10.723199 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:10.723205 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:10.723288 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:10.723358 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:10.724210 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.725055 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.727280 (+ 2225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.728324 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.728486 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.728558 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:10.728780 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 14:56:10.728917 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:56:10.730192 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.723192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:51065 (local address 127.12.73.129:45529)
0808 14:56:10.723437 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:10.723443 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:10.723583 (+ 140us) server_negotiation.cc:407] Connection header received
0808 14:56:10.723714 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:10.723720 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:10.723800 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:10.723896 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:10.724549 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.725754 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.728067 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.729237 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.729398 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.729469 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:10.729933 (+ 464us) server_negotiation.cc:299] Negotiation successful
0808 14:56:10.730031 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260808 14:56:10.730386 16700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.722871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:45529 (local address 127.12.73.130:51065)
0808 14:56:10.723485 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:10.723499 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:10.723602 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:10.723920 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:10.723923 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:10.723941 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:10.724382 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.724395 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.725896 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.725900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.727892 (+ 1992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.727907 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.729595 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.729599 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.729748 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.729781 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 14:56:10.729883 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 14:56:10.730008 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":18,"thread_start_us":328,"threads_started":1}
I20260808 14:56:10.730278 16588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68d478cd880144f58c7fe03af909612c" candidate_uuid: "74042c3f756e48fd84df43b5212bfa8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" is_pre_election: true
I20260808 14:56:10.730918 16588 raft_consensus.cc:2454] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74042c3f756e48fd84df43b5212bfa8d in term 0.
I20260808 14:56:10.731483 16092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68d478cd880144f58c7fe03af909612c" candidate_uuid: "74042c3f756e48fd84df43b5212bfa8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" is_pre_election: true
I20260808 14:56:10.731637 16220 leader_election.cc:302] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74042c3f756e48fd84df43b5212bfa8d, cacd24a79ccd4dc19ca6dfe97bf6883b; no voters:
I20260808 14:56:10.732061 16696 raft_consensus.cc:2781] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:10.732053 16092 raft_consensus.cc:2454] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74042c3f756e48fd84df43b5212bfa8d in term 0.
I20260808 14:56:10.732270 16696 raft_consensus.cc:482] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:10.732384 16696 raft_consensus.cc:3037] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:10.734860 16696 raft_consensus.cc:504] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } }
I20260808 14:56:10.735498 16696 leader_election.cc:288] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [CANDIDATE]: Term 1 election: Requested vote from peers cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361), 41d3f4a2875c46e0b769e124d55ca6e0 (127.12.73.129:45529)
I20260808 14:56:10.736068 16092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68d478cd880144f58c7fe03af909612c" candidate_uuid: "74042c3f756e48fd84df43b5212bfa8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41d3f4a2875c46e0b769e124d55ca6e0"
I20260808 14:56:10.736079 16588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68d478cd880144f58c7fe03af909612c" candidate_uuid: "74042c3f756e48fd84df43b5212bfa8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b"
I20260808 14:56:10.736282 16092 raft_consensus.cc:3037] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:10.736310 16588 raft_consensus.cc:3037] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:10.739614 16588 raft_consensus.cc:2454] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74042c3f756e48fd84df43b5212bfa8d in term 1.
I20260808 14:56:10.739614 16092 raft_consensus.cc:2454] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74042c3f756e48fd84df43b5212bfa8d in term 1.
I20260808 14:56:10.740259 16220 leader_election.cc:302] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74042c3f756e48fd84df43b5212bfa8d, cacd24a79ccd4dc19ca6dfe97bf6883b; no voters:
I20260808 14:56:10.740574 16696 raft_consensus.cc:2781] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:10.741281 16696 raft_consensus.cc:686] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 1 LEADER]: Becoming Leader. State: Replica: 74042c3f756e48fd84df43b5212bfa8d, State: Running, Role: LEADER
I20260808 14:56:10.741918 16696 consensus_queue.cc:237] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } }
I20260808 14:56:10.747234 15813 catalog_manager.cc:5495] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130). New cstate: current_term: 1 leader_uuid: "74042c3f756e48fd84df43b5212bfa8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } health_report { overall_health: UNKNOWN } } }
W20260808 14:56:10.767406 16661 tablet.cc:2369] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 14:56:10 dist-test-slave-z8x9 krb5kdc[15747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200968, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:10.815044 16713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.800071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34785 (local address 127.0.0.1:44190)
0808 14:56:10.800717 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:10.800737 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:10.800881 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:10.801296 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:10.801301 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:10.802229 (+ 928us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:10.802622 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.802633 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.803633 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.803638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.805258 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.805271 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.806020 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.806026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.806217 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.806911 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:10.806951 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:10.809764 (+ 2813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:10.812675 (+ 2911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:10.812685 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:10.812690 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:10.813296 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:10.813624 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:10.813627 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:10.813629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:10.813755 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:10.814262 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:10.814268 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:10.814405 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 14:56:10.814528 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 14:56:10.814724 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":336,"threads_started":1}
I20260808 14:56:10.815080 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.799962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44190 (local address 127.12.73.190:34785)
0808 14:56:10.800170 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:10.800176 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:10.800829 (+ 653us) server_negotiation.cc:407] Connection header received
0808 14:56:10.801015 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:10.801018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:10.801105 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:10.801231 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:10.802769 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.803483 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.805383 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.805848 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.805935 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.809938 (+ 4003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:10.809943 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:10.809947 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:10.809974 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:10.812565 (+ 2591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:10.813408 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:10.813412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:10.813414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:10.813531 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:10.813867 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:10.813870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:10.813872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:10.814143 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:10.814248 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:10.814643 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 14:56:10.814835 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":63}
I20260808 14:56:10.819787 15813 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:44190:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:56:10.820716 15813 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:10.827396 16542 tablet_service.cc:1467] Processing CreateTablet for tablet 884c0595e58e47279b051dfb8518d6e3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=50c3c560352c4d9d8bd46bd14331e675]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:56:10.827133 16060 tablet_service.cc:1467] Processing CreateTablet for tablet 884c0595e58e47279b051dfb8518d6e3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=50c3c560352c4d9d8bd46bd14331e675]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:56:10.827482 16302 tablet_service.cc:1467] Processing CreateTablet for tablet 884c0595e58e47279b051dfb8518d6e3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=50c3c560352c4d9d8bd46bd14331e675]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:56:10.828238 16542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 884c0595e58e47279b051dfb8518d6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:10.828248 16060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 884c0595e58e47279b051dfb8518d6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:10.828243 16302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 884c0595e58e47279b051dfb8518d6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:10.833969 16688 tablet_bootstrap.cc:492] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b: Bootstrap starting.
I20260808 14:56:10.835541 16686 tablet_bootstrap.cc:492] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: Bootstrap starting.
I20260808 14:56:10.835641 16688 tablet_bootstrap.cc:654] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:10.835911 16685 tablet_bootstrap.cc:492] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d: Bootstrap starting.
I20260808 14:56:10.837453 16686 tablet_bootstrap.cc:654] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:10.837721 16685 tablet_bootstrap.cc:654] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:10.838541 16688 tablet_bootstrap.cc:492] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b: No bootstrap required, opened a new log
I20260808 14:56:10.838740 16688 ts_tablet_manager.cc:1397] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 14:56:10.839406 16688 raft_consensus.cc:348] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:10.839668 16688 raft_consensus.cc:374] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:10.839788 16688 raft_consensus.cc:729] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacd24a79ccd4dc19ca6dfe97bf6883b, State: Initialized, Role: FOLLOWER
I20260808 14:56:10.840030 16686 tablet_bootstrap.cc:492] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: No bootstrap required, opened a new log
I20260808 14:56:10.840181 16686 ts_tablet_manager.cc:1397] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 14:56:10.840061 16688 consensus_queue.cc:260] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:10.840523 16694 tablet_replica.cc:439] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } }
I20260808 14:56:10.840849 16685 tablet_bootstrap.cc:492] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d: No bootstrap required, opened a new log
I20260808 14:56:10.840902 16694 tablet_replica.cc:442] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:10.840984 16685 ts_tablet_manager.cc:1397] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 14:56:10.840966 16686 raft_consensus.cc:348] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:10.841231 16686 raft_consensus.cc:374] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:10.841353 16686 raft_consensus.cc:729] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41d3f4a2875c46e0b769e124d55ca6e0, State: Initialized, Role: FOLLOWER
I20260808 14:56:10.841585 16686 consensus_queue.cc:260] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:10.841845 16685 raft_consensus.cc:348] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:10.842079 16685 raft_consensus.cc:374] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:10.842176 16685 raft_consensus.cc:729] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74042c3f756e48fd84df43b5212bfa8d, State: Initialized, Role: FOLLOWER
I20260808 14:56:10.842072 16695 tablet_replica.cc:439] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } }
I20260808 14:56:10.842463 16695 tablet_replica.cc:442] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:10.842399 16685 consensus_queue.cc:260] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:10.842967 16686 ts_tablet_manager.cc:1428] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:10.843034 16685 ts_tablet_manager.cc:1428] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:56:10.843010 16696 tablet_replica.cc:439] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } }
I20260808 14:56:10.843252 16696 tablet_replica.cc:442] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:10.844403 16688 ts_tablet_manager.cc:1428] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260808 14:56:10.916250 16695 raft_consensus.cc:482] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:10.916617 16695 raft_consensus.cc:504] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:10.918347 16695 leader_election.cc:288] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735), cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361)
I20260808 14:56:10.926378 16680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.918624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:39275 (local address 127.12.73.130:42735)
0808 14:56:10.918866 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:10.918873 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:10.919484 (+ 611us) server_negotiation.cc:407] Connection header received
0808 14:56:10.919696 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:10.919703 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:10.919810 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:10.919918 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:10.920819 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.921869 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.924583 (+ 2714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.925386 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.925575 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.925649 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:10.926007 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 14:56:10.926144 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 14:56:10.926393 16682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.919171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:59653 (local address 127.12.73.131:45361)
0808 14:56:10.919386 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:10.919392 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:10.919717 (+ 325us) server_negotiation.cc:407] Connection header received
0808 14:56:10.919857 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:10.919865 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:10.919941 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:10.920028 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:10.920851 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.921696 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.924544 (+ 2848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.925378 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.925547 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.925634 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:10.925940 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 14:56:10.926081 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 14:56:10.926751 16718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.918808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:45361 (local address 127.12.73.129:59653)
0808 14:56:10.919611 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:10.919628 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:10.919736 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:10.920067 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:10.920074 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:10.920114 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:10.920626 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.920635 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.921845 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.921853 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.924388 (+ 2535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.924398 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.925603 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.925610 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.925777 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.925802 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 14:56:10.925881 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:56:10.926020 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"mutex_wait_us":139,"thread_start_us":451,"threads_started":1}
I20260808 14:56:10.926792 16717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.918532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:42735 (local address 127.12.73.129:39275)
0808 14:56:10.919331 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:10.919372 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:10.919532 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:10.919937 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:10.919941 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:10.919961 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:10.920573 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.920618 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.922003 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.922009 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.924364 (+ 2355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.924383 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.925658 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.925668 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.925815 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.925838 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:56:10.925959 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 14:56:10.926087 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"mutex_wait_us":108,"thread_start_us":427,"threads_started":1}
I20260808 14:56:10.927496 16588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "884c0595e58e47279b051dfb8518d6e3" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" is_pre_election: true
I20260808 14:56:10.927819 16588 raft_consensus.cc:2454] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 0.
I20260808 14:56:10.927839 16350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "884c0595e58e47279b051dfb8518d6e3" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74042c3f756e48fd84df43b5212bfa8d" is_pre_election: true
I20260808 14:56:10.928305 15976 leader_election.cc:302] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41d3f4a2875c46e0b769e124d55ca6e0, cacd24a79ccd4dc19ca6dfe97bf6883b; no voters:
I20260808 14:56:10.928311 16350 raft_consensus.cc:2454] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 0.
I20260808 14:56:10.928695 16695 raft_consensus.cc:2781] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:10.928864 16695 raft_consensus.cc:482] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:10.928982 16695 raft_consensus.cc:3037] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:10.931154 16695 raft_consensus.cc:504] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:10.931732 16695 leader_election.cc:288] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 election: Requested vote from peers 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735), cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361)
I20260808 14:56:10.932219 16350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "884c0595e58e47279b051dfb8518d6e3" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74042c3f756e48fd84df43b5212bfa8d"
I20260808 14:56:10.932253 16588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "884c0595e58e47279b051dfb8518d6e3" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b"
I20260808 14:56:10.932437 16350 raft_consensus.cc:3037] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:10.932456 16588 raft_consensus.cc:3037] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:10.935526 16588 raft_consensus.cc:2454] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 1.
I20260808 14:56:10.935696 16350 raft_consensus.cc:2454] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 1.
I20260808 14:56:10.935989 15976 leader_election.cc:302] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41d3f4a2875c46e0b769e124d55ca6e0, cacd24a79ccd4dc19ca6dfe97bf6883b; no voters:
I20260808 14:56:10.936281 16695 raft_consensus.cc:2781] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:10.936784 16695 raft_consensus.cc:686] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 LEADER]: Becoming Leader. State: Replica: 41d3f4a2875c46e0b769e124d55ca6e0, State: Running, Role: LEADER
I20260808 14:56:10.937376 16695 consensus_queue.cc:237] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:10.940212 16720 tablet_replica.cc:439] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: TxnStatusTablet state changed. Reason: New leader 41d3f4a2875c46e0b769e124d55ca6e0. Latest consensus state: current_term: 1 leader_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } }
I20260808 14:56:10.940555 16720 tablet_replica.cc:442] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:56:10.941355 16722 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:56:10.941658 16722 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:56:10.942266 15813 catalog_manager.cc:5495] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41d3f4a2875c46e0b769e124d55ca6e0 (127.12.73.129). New cstate: current_term: 1 leader_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260808 14:56:10.972380 16713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.966161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:45529 (local address 127.0.0.1:53944)
0808 14:56:10.966397 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:10.966419 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:10.966546 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:10.967036 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:10.967039 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:10.967049 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:56:10.967209 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.967215 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.968673 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.968676 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.969736 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:10.969748 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.970746 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.970750 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:10.970905 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.970956 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:56:10.971972 (+ 1016us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:56:10.971988 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 14:56:10.972035 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:56:10.972146 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 14:56:10.972582 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:10.966236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53944 (local address 127.12.73.129:45529)
0808 14:56:10.966422 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:10.966428 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:10.966477 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:56:10.966747 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:10.966753 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:10.966859 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:10.967033 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:10.967334 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.968549 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.969876 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:10.970562 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:10.970735 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:10.971159 (+ 424us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:10.971849 (+ 690us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:10.972028 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:10.972081 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 14:56:10.972239 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:56:10.981734 16350 raft_consensus.cc:1261] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Refusing update from remote peer 41d3f4a2875c46e0b769e124d55ca6e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:10.981842 16588 raft_consensus.cc:1261] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Refusing update from remote peer 41d3f4a2875c46e0b769e124d55ca6e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:10.982889 16695 consensus_queue.cc:1035] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:10.983287 16720 consensus_queue.cc:1035] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:11.003214 16696 tablet_replica.cc:439] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d: TxnStatusTablet state changed. Reason: New leader 41d3f4a2875c46e0b769e124d55ca6e0. Latest consensus state: current_term: 1 leader_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } }
I20260808 14:56:11.003602 16696 tablet_replica.cc:442] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:11.006078 16727 mvcc.cc:205] Tried to move back new op lower bound from 7316279177130360832 to 7316279176962809856. Current Snapshot: MvccSnapshot[applied={T|T < 7316279177130360832}]
I20260808 14:56:11.007328 16695 tablet_replica.cc:439] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } }
I20260808 14:56:11.007652 16695 tablet_replica.cc:442] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:56:11.008901 16694 tablet_replica.cc:439] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b: TxnStatusTablet state changed. Reason: New leader 41d3f4a2875c46e0b769e124d55ca6e0. Latest consensus state: current_term: 1 leader_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } }
I20260808 14:56:11.009140 16694 tablet_replica.cc:442] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:11.010838 16695 tablet_replica.cc:439] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } }
I20260808 14:56:11.011116 16695 tablet_replica.cc:442] T 884c0595e58e47279b051dfb8518d6e3 P 41d3f4a2875c46e0b769e124d55ca6e0: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:56:11.014528 16732 mvcc.cc:205] Tried to move back new op lower bound from 7316279177130360832 to 7316279176962809856. Current Snapshot: MvccSnapshot[applied={T|T < 7316279177130360832}]
I20260808 14:56:11.011322 16728 mvcc.cc:205] Tried to move back new op lower bound from 7316279177130360832 to 7316279176962809856. Current Snapshot: MvccSnapshot[applied={T|T < 7316279177130360832}]
I20260808 14:56:11.019443 16696 tablet_replica.cc:439] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } }
I20260808 14:56:11.019749 16696 tablet_replica.cc:442] T 884c0595e58e47279b051dfb8518d6e3 P 74042c3f756e48fd84df43b5212bfa8d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:11.022802 16694 tablet_replica.cc:439] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } } }
I20260808 14:56:11.023077 16694 tablet_replica.cc:442] T 884c0595e58e47279b051dfb8518d6e3 P cacd24a79ccd4dc19ca6dfe97bf6883b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:56:11.030778 16680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:11.024259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42108 (local address 127.12.73.130:42735)
0808 14:56:11.024429 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:11.024435 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:11.024940 (+ 505us) server_negotiation.cc:407] Connection header received
0808 14:56:11.025034 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:11.025039 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:11.025139 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:11.025332 (+ 193us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:11.025765 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.026954 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.028266 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.028895 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.029018 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:11.029477 (+ 459us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:11.030136 (+ 659us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:11.030307 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:11.030392 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 14:56:11.030472 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:56:11.047274 16748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:11.040821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:45529 (local address 127.12.73.130:58793)
0808 14:56:11.041541 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:11.041556 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:11.041661 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:11.042009 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:11.042012 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:11.042021 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:56:11.042351 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:11.042359 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.043946 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.043949 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:11.045106 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:11.045117 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.046247 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.046252 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:11.046365 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:11.046412 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:56:11.046831 (+ 419us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:56:11.046847 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 14:56:11.046906 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:56:11.046997 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":390,"threads_started":1}
I20260808 14:56:11.047349 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:11.040807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:58793 (local address 127.12.73.129:45529)
0808 14:56:11.041021 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:11.041027 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:11.041645 (+ 618us) server_negotiation.cc:407] Connection header received
0808 14:56:11.041779 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:11.041785 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:11.041886 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:11.041981 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:11.042519 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.043715 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.045364 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.046078 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.046218 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:11.046606 (+ 388us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:11.046732 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:11.046824 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:11.046957 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 14:56:11.047045 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:56:11.057416 16588 raft_consensus.cc:1261] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Refusing update from remote peer 74042c3f756e48fd84df43b5212bfa8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:11.058058 16092 raft_consensus.cc:1261] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Refusing update from remote peer 74042c3f756e48fd84df43b5212bfa8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:11.058629 16702 consensus_queue.cc:1035] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:11.059427 16696 consensus_queue.cc:1035] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:11.112947 16680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:11.099722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:53803 (local address 127.12.73.130:42735)
0808 14:56:11.099938 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:11.099944 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:11.106869 (+ 6925us) server_negotiation.cc:407] Connection header received
0808 14:56:11.107088 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:11.107094 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:11.107184 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:11.107283 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:11.107868 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.108582 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.110890 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.111588 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.111730 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:11.112156 (+ 426us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:11.112295 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:11.112409 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:11.112516 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 14:56:11.112606 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:56:11.113018 16762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:11.099664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:42735 (local address 127.12.73.129:53803)
0808 14:56:11.106748 (+ 7084us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:11.106765 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:11.106937 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:11.107312 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:11.107316 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:11.107328 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:56:11.107703 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:11.107711 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.108723 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.108728 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:11.110740 (+ 2012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:11.110755 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.111771 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.111776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:11.111920 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:11.111976 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:56:11.112417 (+ 441us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:56:11.112431 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:56:11.112491 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 14:56:11.112597 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6885,"thread_start_us":7385,"threads_started":1}
I20260808 14:56:11.151369 15813 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44180:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:11.151684 15813 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44180:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:11.155779 15813 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f: Sending DeleteTablet for 3 replicas of tablet 68d478cd880144f58c7fe03af909612c
I20260808 14:56:11.156883 16302 tablet_service.cc:1514] Processing DeleteTablet for tablet 68d478cd880144f58c7fe03af909612c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:11 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:42106
I20260808 14:56:11.157390 16542 tablet_service.cc:1514] Processing DeleteTablet for tablet 68d478cd880144f58c7fe03af909612c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:11 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:53182
I20260808 14:56:11.158334 16060 tablet_service.cc:1514] Processing DeleteTablet for tablet 68d478cd880144f58c7fe03af909612c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:11 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:53934
I20260808 14:56:11.162744 15813 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44180:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:56:11.163437 15813 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:11.169693 16766 tablet_replica.cc:330] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d: stopping tablet replica
I20260808 14:56:11.174041 16766 raft_consensus.cc:2229] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:56:11.174835 16766 raft_consensus.cc:2258] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:11.176407 16541 tablet_service.cc:1467] Processing CreateTablet for tablet f9e619b582a4440d852c3d0def61d910 (DEFAULT_TABLE table=test-table [id=9f494737becc4f8c991397777b5ec8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:11.176718 16056 tablet_service.cc:1467] Processing CreateTablet for tablet f9e619b582a4440d852c3d0def61d910 (DEFAULT_TABLE table=test-table [id=9f494737becc4f8c991397777b5ec8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:11.176925 16541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9e619b582a4440d852c3d0def61d910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:11.177363 16056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9e619b582a4440d852c3d0def61d910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:11.177615 16302 tablet_service.cc:1467] Processing CreateTablet for tablet f9e619b582a4440d852c3d0def61d910 (DEFAULT_TABLE table=test-table [id=9f494737becc4f8c991397777b5ec8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:11.178066 16302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9e619b582a4440d852c3d0def61d910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:11.184494 16686 tablet_bootstrap.cc:492] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0: Bootstrap starting.
I20260808 14:56:11.186148 16688 tablet_bootstrap.cc:492] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b: Bootstrap starting.
I20260808 14:56:11.186491 16686 tablet_bootstrap.cc:654] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:11.187829 16688 tablet_bootstrap.cc:654] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:11.197515 16769 tablet_replica.cc:330] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0: stopping tablet replica
I20260808 14:56:11.198036 16766 ts_tablet_manager.cc:1905] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:11.198120 16769 raft_consensus.cc:2229] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:11.198568 16769 raft_consensus.cc:2258] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:11.199265 16685 tablet_bootstrap.cc:492] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d: Bootstrap starting.
I20260808 14:56:11.201609 16685 tablet_bootstrap.cc:654] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:11.202420 16686 tablet_bootstrap.cc:492] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0: No bootstrap required, opened a new log
I20260808 14:56:11.202611 16686 ts_tablet_manager.cc:1397] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.007s
I20260808 14:56:11.203634 16686 raft_consensus.cc:348] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:11.203970 16686 raft_consensus.cc:374] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:11.204070 16686 raft_consensus.cc:729] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41d3f4a2875c46e0b769e124d55ca6e0, State: Initialized, Role: FOLLOWER
I20260808 14:56:11.204432 16686 consensus_queue.cc:260] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:11.205147 16686 ts_tablet_manager.cc:1428] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 14:56:11.211764 16688 tablet_bootstrap.cc:492] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b: No bootstrap required, opened a new log
I20260808 14:56:11.212040 16688 ts_tablet_manager.cc:1397] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.009s
I20260808 14:56:11.212667 16767 tablet_replica.cc:330] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b: stopping tablet replica
I20260808 14:56:11.213068 16688 raft_consensus.cc:348] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:11.213456 16688 raft_consensus.cc:374] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:11.213590 16688 raft_consensus.cc:729] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacd24a79ccd4dc19ca6dfe97bf6883b, State: Initialized, Role: FOLLOWER
I20260808 14:56:11.213951 16688 consensus_queue.cc:260] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:11.214697 16688 ts_tablet_manager.cc:1428] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:56:11.216827 16769 ts_tablet_manager.cc:1905] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:11.224907 16769 ts_tablet_manager.cc:1918] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:56:11.225103 16769 log.cc:1196] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/68d478cd880144f58c7fe03af909612c
I20260808 14:56:11.214130 16767 raft_consensus.cc:2229] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:11.225112 16766 ts_tablet_manager.cc:1918] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:56:11.225538 16766 log.cc:1196] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/68d478cd880144f58c7fe03af909612c
I20260808 14:56:11.225538 16767 raft_consensus.cc:2258] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:11.226184 16766 ts_tablet_manager.cc:1939] T 68d478cd880144f58c7fe03af909612c P 74042c3f756e48fd84df43b5212bfa8d: Deleting consensus metadata
I20260808 14:56:11.226671 16685 tablet_bootstrap.cc:492] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d: No bootstrap required, opened a new log
I20260808 14:56:11.226874 16685 ts_tablet_manager.cc:1397] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.003s
I20260808 14:56:11.227802 16685 raft_consensus.cc:348] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:11.228061 16685 raft_consensus.cc:374] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:11.228152 16685 raft_consensus.cc:729] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74042c3f756e48fd84df43b5212bfa8d, State: Initialized, Role: FOLLOWER
I20260808 14:56:11.228439 16685 consensus_queue.cc:260] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:11.229084 16685 ts_tablet_manager.cc:1428] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 14:56:11.229846 16769 ts_tablet_manager.cc:1939] T 68d478cd880144f58c7fe03af909612c P 41d3f4a2875c46e0b769e124d55ca6e0: Deleting consensus metadata
I20260808 14:56:11.230877 16767 ts_tablet_manager.cc:1905] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:11.232009 15794 catalog_manager.cc:4841] TS 41d3f4a2875c46e0b769e124d55ca6e0 (127.12.73.129:45529): tablet 68d478cd880144f58c7fe03af909612c (table test-table [id=579425f4d94d4e13bfa8be3170a1c4c5]) successfully deleted
I20260808 14:56:11.234547 15791 catalog_manager.cc:4841] TS 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735): tablet 68d478cd880144f58c7fe03af909612c (table test-table [id=579425f4d94d4e13bfa8be3170a1c4c5]) successfully deleted
I20260808 14:56:11.237218 16767 ts_tablet_manager.cc:1918] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:56:11.237390 16767 log.cc:1196] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/68d478cd880144f58c7fe03af909612c
I20260808 14:56:11.237914 16767 ts_tablet_manager.cc:1939] T 68d478cd880144f58c7fe03af909612c P cacd24a79ccd4dc19ca6dfe97bf6883b: Deleting consensus metadata
I20260808 14:56:11.239663 15794 catalog_manager.cc:4841] TS cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361): tablet 68d478cd880144f58c7fe03af909612c (table test-table [id=579425f4d94d4e13bfa8be3170a1c4c5]) successfully deleted
I20260808 14:56:11.256901 16749 raft_consensus.cc:482] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:11.257097 16749 raft_consensus.cc:504] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:11.257921 16749 leader_election.cc:288] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735), cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361)
I20260808 14:56:11.258610 16587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9e619b582a4440d852c3d0def61d910" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" is_pre_election: true
I20260808 14:56:11.258668 16350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9e619b582a4440d852c3d0def61d910" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74042c3f756e48fd84df43b5212bfa8d" is_pre_election: true
I20260808 14:56:11.258865 16587 raft_consensus.cc:2454] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 0.
I20260808 14:56:11.258931 16350 raft_consensus.cc:2454] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 0.
I20260808 14:56:11.259320 15976 leader_election.cc:302] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41d3f4a2875c46e0b769e124d55ca6e0, cacd24a79ccd4dc19ca6dfe97bf6883b; no voters:
I20260808 14:56:11.259685 16749 raft_consensus.cc:2781] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:11.259800 16749 raft_consensus.cc:482] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:11.259884 16749 raft_consensus.cc:3037] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:11.263103 16749 raft_consensus.cc:504] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:11.264345 16587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9e619b582a4440d852c3d0def61d910" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b"
I20260808 14:56:11.264338 16350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9e619b582a4440d852c3d0def61d910" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74042c3f756e48fd84df43b5212bfa8d"
I20260808 14:56:11.264542 16587 raft_consensus.cc:3037] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:11.264552 16350 raft_consensus.cc:3037] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:11.267619 16587 raft_consensus.cc:2454] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 1.
I20260808 14:56:11.267778 16350 raft_consensus.cc:2454] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 1.
I20260808 14:56:11.268352 15976 leader_election.cc:302] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41d3f4a2875c46e0b769e124d55ca6e0, cacd24a79ccd4dc19ca6dfe97bf6883b; no voters:
I20260808 14:56:11.268654 16720 raft_consensus.cc:2781] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:11.268898 16720 raft_consensus.cc:686] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 LEADER]: Becoming Leader. State: Replica: 41d3f4a2875c46e0b769e124d55ca6e0, State: Running, Role: LEADER
I20260808 14:56:11.268692 16749 leader_election.cc:288] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 election: Requested vote from peers 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735), cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361)
I20260808 14:56:11.270073 16720 consensus_queue.cc:237] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:11.273056 15813 catalog_manager.cc:5495] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41d3f4a2875c46e0b769e124d55ca6e0 (127.12.73.129). New cstate: current_term: 1 leader_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260808 14:56:11.312211 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:11.305610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53958 (local address 127.12.73.129:45529)
0808 14:56:11.305810 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:11.305816 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:11.306101 (+ 285us) server_negotiation.cc:407] Connection header received
0808 14:56:11.306286 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:11.306292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:11.306376 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:11.306480 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:11.306899 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.308055 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.310019 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.310716 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.310844 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:11.311388 (+ 544us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:11.311542 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:11.311659 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:11.311828 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 14:56:11.311919 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:56:11.329569 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:11.323147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:51671 (local address 127.12.73.129:45529)
0808 14:56:11.323301 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:11.323306 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:11.323326 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:56:11.323383 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:11.323388 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:11.323467 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:11.323559 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:11.323953 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.325082 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.327210 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.327932 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.328066 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:11.328562 (+ 496us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:11.328707 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:11.328802 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:11.328984 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 14:56:11.329142 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":49}
I20260808 14:56:11.329619 16762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:11.322878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:45529 (local address 127.12.73.129:51671)
0808 14:56:11.323093 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:11.323114 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:11.323220 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:11.323591 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:11.323596 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:11.323615 (+ 19us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:56:11.323806 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:11.323823 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.325309 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.325316 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:11.327043 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:11.327059 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:11.328115 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:11.328122 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:11.328329 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:11.328390 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:56:11.328835 (+ 445us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:56:11.328848 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 14:56:11.328942 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 14:56:11.329216 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"mutex_wait_us":48}
I20260808 14:56:11.342334 16350 raft_consensus.cc:1261] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Refusing update from remote peer 41d3f4a2875c46e0b769e124d55ca6e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:11.342336 16587 raft_consensus.cc:1261] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Refusing update from remote peer 41d3f4a2875c46e0b769e124d55ca6e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:11.342935 16695 consensus_queue.cc:1035] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:11.343215 16749 consensus_queue.cc:1035] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:56:11.382555 16759 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 14:56:13.013908 15813 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44180:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:13.014145 15813 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44180:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:13.018028 15813 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f: Sending DeleteTablet for 3 replicas of tablet f9e619b582a4440d852c3d0def61d910
I20260808 14:56:13.018784 16056 tablet_service.cc:1514] Processing DeleteTablet for tablet f9e619b582a4440d852c3d0def61d910 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:13 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:53934
I20260808 14:56:13.018967 16542 tablet_service.cc:1514] Processing DeleteTablet for tablet f9e619b582a4440d852c3d0def61d910 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:13 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:53182
I20260808 14:56:13.019481 16302 tablet_service.cc:1514] Processing DeleteTablet for tablet f9e619b582a4440d852c3d0def61d910 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:13 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:42106
I20260808 14:56:13.019595 16807 tablet_replica.cc:330] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0: stopping tablet replica
I20260808 14:56:13.019723 16809 tablet_replica.cc:330] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b: stopping tablet replica
I20260808 14:56:13.019804 16807 raft_consensus.cc:2229] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:56:13.019939 16809 raft_consensus.cc:2229] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:13.020264 16809 raft_consensus.cc:2258] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:13.020364 16807 raft_consensus.cc:2258] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:13.021391 16807 ts_tablet_manager.cc:1905] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:13.021518 16809 ts_tablet_manager.cc:1905] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:13.027352 16810 tablet_replica.cc:330] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d: stopping tablet replica
I20260808 14:56:13.027580 16810 raft_consensus.cc:2229] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:13.027900 16810 raft_consensus.cc:2258] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:13.029011 16807 ts_tablet_manager.cc:1918] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:56:13.029261 16807 log.cc:1196] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/f9e619b582a4440d852c3d0def61d910
I20260808 14:56:13.029320 16810 ts_tablet_manager.cc:1905] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:13.029871 16807 ts_tablet_manager.cc:1939] T f9e619b582a4440d852c3d0def61d910 P 41d3f4a2875c46e0b769e124d55ca6e0: Deleting consensus metadata
I20260808 14:56:13.030349 16809 ts_tablet_manager.cc:1918] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:56:13.030534 16809 log.cc:1196] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/f9e619b582a4440d852c3d0def61d910
I20260808 14:56:13.031051 16809 ts_tablet_manager.cc:1939] T f9e619b582a4440d852c3d0def61d910 P cacd24a79ccd4dc19ca6dfe97bf6883b: Deleting consensus metadata
I20260808 14:56:13.031119 15794 catalog_manager.cc:4841] TS 41d3f4a2875c46e0b769e124d55ca6e0 (127.12.73.129:45529): tablet f9e619b582a4440d852c3d0def61d910 (table test-table [id=9f494737becc4f8c991397777b5ec8f4]) successfully deleted
I20260808 14:56:13.032116 15794 catalog_manager.cc:4841] TS cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361): tablet f9e619b582a4440d852c3d0def61d910 (table test-table [id=9f494737becc4f8c991397777b5ec8f4]) successfully deleted
I20260808 14:56:13.034790 16810 ts_tablet_manager.cc:1918] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:56:13.034945 16810 log.cc:1196] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/f9e619b582a4440d852c3d0def61d910
I20260808 14:56:13.035409 16810 ts_tablet_manager.cc:1939] T f9e619b582a4440d852c3d0def61d910 P 74042c3f756e48fd84df43b5212bfa8d: Deleting consensus metadata
I20260808 14:56:13.036273 15791 catalog_manager.cc:4841] TS 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735): tablet f9e619b582a4440d852c3d0def61d910 (table test-table [id=9f494737becc4f8c991397777b5ec8f4]) successfully deleted
Aug 08 14:56:13 dist-test-slave-z8x9 krb5kdc[15747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200973, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:56:13 dist-test-slave-z8x9 krb5kdc[15747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200973, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:13.076326 16822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:13.062762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50004 (local address 127.12.73.190:34785)
0808 14:56:13.063312 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:13.063316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:13.063338 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:56:13.063543 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:13.063547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:13.063619 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:13.063712 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:13.064971 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:13.065823 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:13.067060 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:13.067463 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:13.067558 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:13.071368 (+ 3810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:13.071373 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:13.071376 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:13.071405 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:13.074159 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:13.074732 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:13.074736 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:13.074739 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:13.074870 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:13.075159 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:13.075162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:13.075164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:13.075428 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:13.075603 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:13.075866 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 14:56:13.076028 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":303,"threads_started":1}
I20260808 14:56:13.079717 15813 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50004:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:56:13.080372 15813 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:13.087302 16056 tablet_service.cc:1467] Processing CreateTablet for tablet 5e20afe484b043e7bd8fbe8682ac48f1 (DEFAULT_TABLE table=test-table [id=29327daa1be747ecbaa8f7ddce52dd42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:13.087782 16056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e20afe484b043e7bd8fbe8682ac48f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:13.087684 16542 tablet_service.cc:1467] Processing CreateTablet for tablet 5e20afe484b043e7bd8fbe8682ac48f1 (DEFAULT_TABLE table=test-table [id=29327daa1be747ecbaa8f7ddce52dd42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:13.087689 16302 tablet_service.cc:1467] Processing CreateTablet for tablet 5e20afe484b043e7bd8fbe8682ac48f1 (DEFAULT_TABLE table=test-table [id=29327daa1be747ecbaa8f7ddce52dd42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:13.088158 16302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e20afe484b043e7bd8fbe8682ac48f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:13.088214 16542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e20afe484b043e7bd8fbe8682ac48f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:13.092674 16823 tablet_bootstrap.cc:492] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0: Bootstrap starting.
I20260808 14:56:13.094237 16823 tablet_bootstrap.cc:654] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:13.094978 16824 tablet_bootstrap.cc:492] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b: Bootstrap starting.
I20260808 14:56:13.096962 16823 tablet_bootstrap.cc:492] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0: No bootstrap required, opened a new log
I20260808 14:56:13.097072 16824 tablet_bootstrap.cc:654] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:13.097144 16823 ts_tablet_manager.cc:1397] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 14:56:13.098039 16823 raft_consensus.cc:348] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.098376 16823 raft_consensus.cc:374] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:13.098484 16823 raft_consensus.cc:729] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41d3f4a2875c46e0b769e124d55ca6e0, State: Initialized, Role: FOLLOWER
I20260808 14:56:13.098773 16823 consensus_queue.cc:260] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.099493 16823 ts_tablet_manager.cc:1428] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:56:13.099660 16824 tablet_bootstrap.cc:492] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b: No bootstrap required, opened a new log
I20260808 14:56:13.099871 16824 ts_tablet_manager.cc:1397] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 14:56:13.100981 16824 raft_consensus.cc:348] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.101402 16824 raft_consensus.cc:374] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:13.101642 16824 raft_consensus.cc:729] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacd24a79ccd4dc19ca6dfe97bf6883b, State: Initialized, Role: FOLLOWER
I20260808 14:56:13.101699 16826 tablet_bootstrap.cc:492] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d: Bootstrap starting.
I20260808 14:56:13.101990 16824 consensus_queue.cc:260] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.102862 16824 ts_tablet_manager.cc:1428] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:56:13.103817 16826 tablet_bootstrap.cc:654] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:13.105995 16826 tablet_bootstrap.cc:492] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d: No bootstrap required, opened a new log
I20260808 14:56:13.106155 16826 ts_tablet_manager.cc:1397] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 14:56:13.106974 16826 raft_consensus.cc:348] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.107244 16826 raft_consensus.cc:374] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:13.107360 16826 raft_consensus.cc:729] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74042c3f756e48fd84df43b5212bfa8d, State: Initialized, Role: FOLLOWER
I20260808 14:56:13.107609 16826 consensus_queue.cc:260] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.108342 16826 ts_tablet_manager.cc:1428] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:56:13.310665 16720 raft_consensus.cc:482] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:13.310938 16720 raft_consensus.cc:504] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.311733 16720 leader_election.cc:288] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735), cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361)
I20260808 14:56:13.312426 16586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e20afe484b043e7bd8fbe8682ac48f1" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" is_pre_election: true
I20260808 14:56:13.312426 16347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e20afe484b043e7bd8fbe8682ac48f1" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74042c3f756e48fd84df43b5212bfa8d" is_pre_election: true
I20260808 14:56:13.312712 16586 raft_consensus.cc:2454] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 0.
I20260808 14:56:13.312727 16347 raft_consensus.cc:2454] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 0.
I20260808 14:56:13.313309 15974 leader_election.cc:302] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 41d3f4a2875c46e0b769e124d55ca6e0, 74042c3f756e48fd84df43b5212bfa8d, cacd24a79ccd4dc19ca6dfe97bf6883b; no voters:
I20260808 14:56:13.313668 16720 raft_consensus.cc:2781] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:13.313809 16720 raft_consensus.cc:482] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:13.313923 16720 raft_consensus.cc:3037] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:13.315996 16720 raft_consensus.cc:504] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.316509 16720 leader_election.cc:288] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 election: Requested vote from peers 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735), cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361)
I20260808 14:56:13.317024 16586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e20afe484b043e7bd8fbe8682ac48f1" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b"
I20260808 14:56:13.317078 16347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e20afe484b043e7bd8fbe8682ac48f1" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74042c3f756e48fd84df43b5212bfa8d"
I20260808 14:56:13.317272 16586 raft_consensus.cc:3037] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:13.317385 16347 raft_consensus.cc:3037] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:13.319360 16586 raft_consensus.cc:2454] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 1.
I20260808 14:56:13.319481 16347 raft_consensus.cc:2454] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 1.
I20260808 14:56:13.319896 15976 leader_election.cc:302] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41d3f4a2875c46e0b769e124d55ca6e0, cacd24a79ccd4dc19ca6dfe97bf6883b; no voters:
I20260808 14:56:13.320227 16720 raft_consensus.cc:2781] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:13.320401 16720 raft_consensus.cc:686] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 LEADER]: Becoming Leader. State: Replica: 41d3f4a2875c46e0b769e124d55ca6e0, State: Running, Role: LEADER
I20260808 14:56:13.320691 16720 consensus_queue.cc:237] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.323346 15812 catalog_manager.cc:5495] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41d3f4a2875c46e0b769e124d55ca6e0 (127.12.73.129). New cstate: current_term: 1 leader_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260808 14:56:13.347327 16841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:13.342225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51328 (local address 127.12.73.129:45529)
0808 14:56:13.342842 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:13.342846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:13.342865 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:56:13.342915 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:13.342919 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:13.342976 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:13.343059 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:13.343383 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:13.344186 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:13.345653 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:13.346119 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:13.346217 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:13.346679 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:13.346806 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:13.346874 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:13.347005 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 14:56:13.347073 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":381,"threads_started":1}
I20260808 14:56:13.356328 16586 raft_consensus.cc:1261] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Refusing update from remote peer 41d3f4a2875c46e0b769e124d55ca6e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:13.356463 16347 raft_consensus.cc:1261] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Refusing update from remote peer 41d3f4a2875c46e0b769e124d55ca6e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:13.356966 16785 consensus_queue.cc:1035] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:13.357399 16780 consensus_queue.cc:1035] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:13.400933 15812 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:13.401252 15812 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:13.403935 15812 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f: Sending DeleteTablet for 3 replicas of tablet 5e20afe484b043e7bd8fbe8682ac48f1
I20260808 14:56:13.404618 16056 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e20afe484b043e7bd8fbe8682ac48f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:13 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:53934
I20260808 14:56:13.404726 16542 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e20afe484b043e7bd8fbe8682ac48f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:13 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:53182
I20260808 14:56:13.404721 16302 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e20afe484b043e7bd8fbe8682ac48f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:13 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:42106
I20260808 14:56:13.404920 16807 tablet_replica.cc:330] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0: stopping tablet replica
I20260808 14:56:13.405022 16809 tablet_replica.cc:330] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b: stopping tablet replica
I20260808 14:56:13.405067 16807 raft_consensus.cc:2229] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:56:13.405288 16809 raft_consensus.cc:2229] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:13.405414 16807 raft_consensus.cc:2258] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:13.405544 16810 tablet_replica.cc:330] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d: stopping tablet replica
I20260808 14:56:13.405514 16809 raft_consensus.cc:2258] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:13.405761 16810 raft_consensus.cc:2229] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:13.405958 16810 raft_consensus.cc:2258] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:13.405853 15812 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50004:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 14:56:13.406509 16807 ts_tablet_manager.cc:1905] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:13.406632 16809 ts_tablet_manager.cc:1905] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 14:56:13.406713 15812 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:13.407879 16810 ts_tablet_manager.cc:1905] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:13.411499 16807 ts_tablet_manager.cc:1918] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:56:13.411670 16807 log.cc:1196] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/5e20afe484b043e7bd8fbe8682ac48f1
I20260808 14:56:13.412246 16807 ts_tablet_manager.cc:1939] T 5e20afe484b043e7bd8fbe8682ac48f1 P 41d3f4a2875c46e0b769e124d55ca6e0: Deleting consensus metadata
I20260808 14:56:13.413275 16809 ts_tablet_manager.cc:1918] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:56:13.413445 16809 log.cc:1196] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/5e20afe484b043e7bd8fbe8682ac48f1
I20260808 14:56:13.413872 16809 ts_tablet_manager.cc:1939] T 5e20afe484b043e7bd8fbe8682ac48f1 P cacd24a79ccd4dc19ca6dfe97bf6883b: Deleting consensus metadata
I20260808 14:56:13.414240 15794 catalog_manager.cc:4841] TS 41d3f4a2875c46e0b769e124d55ca6e0 (127.12.73.129:45529): tablet 5e20afe484b043e7bd8fbe8682ac48f1 (table test-table [id=29327daa1be747ecbaa8f7ddce52dd42]) successfully deleted
I20260808 14:56:13.414793 16810 ts_tablet_manager.cc:1918] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:56:13.415004 16810 log.cc:1196] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/5e20afe484b043e7bd8fbe8682ac48f1
I20260808 14:56:13.415405 15794 catalog_manager.cc:4841] TS cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361): tablet 5e20afe484b043e7bd8fbe8682ac48f1 (table test-table [id=29327daa1be747ecbaa8f7ddce52dd42]) successfully deleted
I20260808 14:56:13.415450 16810 ts_tablet_manager.cc:1939] T 5e20afe484b043e7bd8fbe8682ac48f1 P 74042c3f756e48fd84df43b5212bfa8d: Deleting consensus metadata
I20260808 14:56:13.416551 15791 catalog_manager.cc:4841] TS 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735): tablet 5e20afe484b043e7bd8fbe8682ac48f1 (table test-table [id=29327daa1be747ecbaa8f7ddce52dd42]) successfully deleted
I20260808 14:56:13.417512 16056 tablet_service.cc:1467] Processing CreateTablet for tablet ccf3e23586d34aac94dcc2e2f574b463 (DEFAULT_TABLE table=test-table [id=3d5597192bb64b1499129ca91a34218c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:13.417586 16302 tablet_service.cc:1467] Processing CreateTablet for tablet ccf3e23586d34aac94dcc2e2f574b463 (DEFAULT_TABLE table=test-table [id=3d5597192bb64b1499129ca91a34218c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:13.417971 16056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccf3e23586d34aac94dcc2e2f574b463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:13.418017 16302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccf3e23586d34aac94dcc2e2f574b463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:13.418428 16542 tablet_service.cc:1467] Processing CreateTablet for tablet ccf3e23586d34aac94dcc2e2f574b463 (DEFAULT_TABLE table=test-table [id=3d5597192bb64b1499129ca91a34218c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:13.418841 16542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccf3e23586d34aac94dcc2e2f574b463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:13.422896 16826 tablet_bootstrap.cc:492] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d: Bootstrap starting.
I20260808 14:56:13.424343 16826 tablet_bootstrap.cc:654] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:13.424458 16823 tablet_bootstrap.cc:492] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0: Bootstrap starting.
I20260808 14:56:13.424901 16824 tablet_bootstrap.cc:492] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b: Bootstrap starting.
I20260808 14:56:13.426091 16823 tablet_bootstrap.cc:654] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:13.426523 16826 tablet_bootstrap.cc:492] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d: No bootstrap required, opened a new log
I20260808 14:56:13.426689 16824 tablet_bootstrap.cc:654] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:13.426731 16826 ts_tablet_manager.cc:1397] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260808 14:56:13.427562 16826 raft_consensus.cc:348] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.427855 16826 raft_consensus.cc:374] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:13.427942 16826 raft_consensus.cc:729] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74042c3f756e48fd84df43b5212bfa8d, State: Initialized, Role: FOLLOWER
I20260808 14:56:13.428212 16826 consensus_queue.cc:260] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.428682 16826 ts_tablet_manager.cc:1428] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:56:13.429013 16823 tablet_bootstrap.cc:492] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0: No bootstrap required, opened a new log
I20260808 14:56:13.429241 16823 ts_tablet_manager.cc:1397] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 14:56:13.430001 16823 raft_consensus.cc:348] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.430305 16823 raft_consensus.cc:374] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:13.430403 16823 raft_consensus.cc:729] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41d3f4a2875c46e0b769e124d55ca6e0, State: Initialized, Role: FOLLOWER
I20260808 14:56:13.430536 16824 tablet_bootstrap.cc:492] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b: No bootstrap required, opened a new log
I20260808 14:56:13.430719 16824 ts_tablet_manager.cc:1397] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 14:56:13.430683 16823 consensus_queue.cc:260] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.431720 16823 ts_tablet_manager.cc:1428] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:56:13.434779 16824 raft_consensus.cc:348] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.434988 16824 raft_consensus.cc:374] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:13.435086 16824 raft_consensus.cc:729] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cacd24a79ccd4dc19ca6dfe97bf6883b, State: Initialized, Role: FOLLOWER
I20260808 14:56:13.435398 16824 consensus_queue.cc:260] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.436055 16824 ts_tablet_manager.cc:1428] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:56:13.444965 16780 raft_consensus.cc:482] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:13.445233 16780 raft_consensus.cc:504] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.446322 16780 leader_election.cc:288] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735), cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361)
I20260808 14:56:13.446411 16586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccf3e23586d34aac94dcc2e2f574b463" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" is_pre_election: true
I20260808 14:56:13.446620 16586 raft_consensus.cc:2454] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 0.
I20260808 14:56:13.446684 16347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccf3e23586d34aac94dcc2e2f574b463" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74042c3f756e48fd84df43b5212bfa8d" is_pre_election: true
I20260808 14:56:13.446981 16347 raft_consensus.cc:2454] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 0.
I20260808 14:56:13.447064 15976 leader_election.cc:302] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41d3f4a2875c46e0b769e124d55ca6e0, cacd24a79ccd4dc19ca6dfe97bf6883b; no voters:
I20260808 14:56:13.447378 16780 raft_consensus.cc:2781] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:13.447464 16780 raft_consensus.cc:482] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:13.447551 16780 raft_consensus.cc:3037] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:13.449697 16780 raft_consensus.cc:504] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.450264 16780 leader_election.cc:288] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 election: Requested vote from peers 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735), cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361)
I20260808 14:56:13.450671 16347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccf3e23586d34aac94dcc2e2f574b463" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74042c3f756e48fd84df43b5212bfa8d"
I20260808 14:56:13.450723 16586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccf3e23586d34aac94dcc2e2f574b463" candidate_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b"
I20260808 14:56:13.450850 16347 raft_consensus.cc:3037] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:13.450933 16586 raft_consensus.cc:3037] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:13.453739 16347 raft_consensus.cc:2454] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 1.
I20260808 14:56:13.453821 16586 raft_consensus.cc:2454] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41d3f4a2875c46e0b769e124d55ca6e0 in term 1.
I20260808 14:56:13.454193 15974 leader_election.cc:302] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41d3f4a2875c46e0b769e124d55ca6e0, 74042c3f756e48fd84df43b5212bfa8d; no voters:
I20260808 14:56:13.454473 16780 raft_consensus.cc:2781] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:13.454660 16780 raft_consensus.cc:686] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 LEADER]: Becoming Leader. State: Replica: 41d3f4a2875c46e0b769e124d55ca6e0, State: Running, Role: LEADER
I20260808 14:56:13.455147 16780 consensus_queue.cc:237] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } }
I20260808 14:56:13.457864 15813 catalog_manager.cc:5495] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41d3f4a2875c46e0b769e124d55ca6e0 (127.12.73.129). New cstate: current_term: 1 leader_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41d3f4a2875c46e0b769e124d55ca6e0" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260808 14:56:13.482494 16347 raft_consensus.cc:1261] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Refusing update from remote peer 41d3f4a2875c46e0b769e124d55ca6e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:13.482728 16586 raft_consensus.cc:1261] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Refusing update from remote peer 41d3f4a2875c46e0b769e124d55ca6e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:13.483402 16780 consensus_queue.cc:1035] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cacd24a79ccd4dc19ca6dfe97bf6883b" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:13.483737 16856 consensus_queue.cc:1035] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74042c3f756e48fd84df43b5212bfa8d" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:56:13.502105 16778 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 14:56:15.079574 15811 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:15.079828 15811 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:15.083885 15811 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c7ad3585003406f9eafb6bf5314497f: Sending DeleteTablet for 3 replicas of tablet ccf3e23586d34aac94dcc2e2f574b463
I20260808 14:56:15.084654 16060 tablet_service.cc:1514] Processing DeleteTablet for tablet ccf3e23586d34aac94dcc2e2f574b463 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:15 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:53934
I20260808 14:56:15.084705 16302 tablet_service.cc:1514] Processing DeleteTablet for tablet ccf3e23586d34aac94dcc2e2f574b463 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:15 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:42106
I20260808 14:56:15.084831 16542 tablet_service.cc:1514] Processing DeleteTablet for tablet ccf3e23586d34aac94dcc2e2f574b463 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:15 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:53182
I20260808 14:56:15.087226 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15942
I20260808 14:56:15.088342 16891 tablet_replica.cc:330] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d: stopping tablet replica
I20260808 14:56:15.088533 16890 tablet_replica.cc:330] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0: stopping tablet replica
I20260808 14:56:15.088630 16891 raft_consensus.cc:2229] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:15.088723 16893 tablet_replica.cc:330] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b: stopping tablet replica
I20260808 14:56:15.088850 16890 raft_consensus.cc:2229] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:56:15.088966 16891 raft_consensus.cc:2258] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:15.088953 16893 raft_consensus.cc:2229] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:15.089210 16893 raft_consensus.cc:2258] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:15.089411 16890 raft_consensus.cc:2258] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:15.090030 16891 ts_tablet_manager.cc:1905] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:15.090230 16893 ts_tablet_manager.cc:1905] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:15.090588 16890 ts_tablet_manager.cc:1905] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:15.096840 16893 ts_tablet_manager.cc:1918] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:56:15.096853 16891 ts_tablet_manager.cc:1918] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:56:15.096978 16891 log.cc:1196] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/ccf3e23586d34aac94dcc2e2f574b463
I20260808 14:56:15.097064 16893 log.cc:1196] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/ccf3e23586d34aac94dcc2e2f574b463
I20260808 14:56:15.097566 16891 ts_tablet_manager.cc:1939] T ccf3e23586d34aac94dcc2e2f574b463 P 74042c3f756e48fd84df43b5212bfa8d: Deleting consensus metadata
I20260808 14:56:15.097607 16893 ts_tablet_manager.cc:1939] T ccf3e23586d34aac94dcc2e2f574b463 P cacd24a79ccd4dc19ca6dfe97bf6883b: Deleting consensus metadata
I20260808 14:56:15.098722 15794 catalog_manager.cc:4841] TS cacd24a79ccd4dc19ca6dfe97bf6883b (127.12.73.131:45361): tablet ccf3e23586d34aac94dcc2e2f574b463 (table test-table [id=3d5597192bb64b1499129ca91a34218c]) successfully deleted
I20260808 14:56:15.098719 15791 catalog_manager.cc:4841] TS 74042c3f756e48fd84df43b5212bfa8d (127.12.73.130:42735): tablet ccf3e23586d34aac94dcc2e2f574b463 (table test-table [id=3d5597192bb64b1499129ca91a34218c]) successfully deleted
I20260808 14:56:15.098903 16890 ts_tablet_manager.cc:1918] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:56:15.099052 16890 log.cc:1196] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/ccf3e23586d34aac94dcc2e2f574b463
I20260808 14:56:15.099586 16890 ts_tablet_manager.cc:1939] T ccf3e23586d34aac94dcc2e2f574b463 P 41d3f4a2875c46e0b769e124d55ca6e0: Deleting consensus metadata
I20260808 14:56:15.100797 15794 catalog_manager.cc:4841] TS 41d3f4a2875c46e0b769e124d55ca6e0 (127.12.73.129:45529): tablet ccf3e23586d34aac94dcc2e2f574b463 (table test-table [id=3d5597192bb64b1499129ca91a34218c]) successfully deleted
Aug 08 14:56:15 dist-test-slave-z8x9 krb5kdc[15747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200973, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:56:15.119288 16897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:15.088784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51338 (local address 127.12.73.129:45529)
0808 14:56:15.101132 (+ 12348us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:15.101141 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:15.101684 (+ 543us) server_negotiation.cc:407] Connection header received
0808 14:56:15.101910 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:15.101914 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:15.101974 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:15.102087 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:15.103348 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:15.104083 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:15.105337 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:15.105762 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:15.105901 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:15.114116 (+ 8215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:15.114131 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:15.114148 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:15.114179 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:15.116843 (+ 2664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:15.117555 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:15.117562 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:15.117564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:15.117735 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:15.118051 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:15.118054 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:15.118056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:15.118390 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:15.118606 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:15.118860 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 14:56:15.119023 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12182,"thread_start_us":12030,"threads_started":1}
W20260808 14:56:15.119957 16177 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51338
W20260808 14:56:15.120577 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15942: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:56:15.120795 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 15942
I20260808 14:56:15.156662 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16193
Aug 08 14:56:15 dist-test-slave-z8x9 krb5kdc[15747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200973, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:56:15.171540 16898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:15.157500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42986 (local address 127.12.73.130:42735)
0808 14:56:15.158071 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:15.158076 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:15.158092 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:56:15.158148 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:15.158152 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:15.158221 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:15.158313 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:15.159567 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:15.160323 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:15.161670 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:15.162051 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:15.162142 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:15.166225 (+ 4083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:15.166240 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:15.166256 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:15.166294 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:15.169260 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:15.169839 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:15.169846 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:15.169849 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:15.169980 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:15.170286 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:15.170289 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:15.170291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:15.170647 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:15.170885 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:15.171085 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 14:56:15.171285 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":317,"threads_started":1}
W20260808 14:56:15.172237 16425 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42986
W20260808 14:56:15.172912 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16193: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:56:15.173058 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 16193
I20260808 14:56:15.202876 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16442
Aug 08 14:56:15 dist-test-slave-z8x9 krb5kdc[15747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200973, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:56:15.218226 16900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:15.203662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40734 (local address 127.12.73.131:45361)
0808 14:56:15.204212 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:15.204217 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:15.204233 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:56:15.204288 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:15.204291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:15.204353 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:15.204452 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:15.205824 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:15.206634 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:15.207834 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:15.208227 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:15.208317 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:15.212619 (+ 4302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:15.212635 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:15.212652 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:15.212687 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:15.215732 (+ 3045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:15.216370 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:15.216378 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:15.216380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:15.216533 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:15.216833 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:15.216845 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:15.216847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:15.217231 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:15.217459 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:15.217669 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 14:56:15.217844 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":321,"threads_started":1}
W20260808 14:56:15.218910 16647 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40734
W20260808 14:56:15.219513 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16442: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:56:15.219692 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 16442
I20260808 14:56:15.246043 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15766
I20260808 14:56:15.247228 15886 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:15.364377 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 15766
2026-08-08T14:56:15Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8540 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:56:15 dist-test-slave-z8x9 krb5kdc[16905](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:56:15 dist-test-slave-z8x9 krb5kdc[16905](info): set up 2 sockets
Aug 08 14:56:15 dist-test-slave-z8x9 krb5kdc[16905](info): commencing operation
krb5kdc: starting...
W20260808 14:56:16.694177 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.000s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:56:16 dist-test-slave-z8x9 krb5kdc[16905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:56:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:56:16.904538 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:42021
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:35311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:42021
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:17.234512 16925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:17.234828 16925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:17.235000 16925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:17.243227 16925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:17.243358 16925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:17.243450 16925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:17.243546 16925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:17.243618 16925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:17.253496 16925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:42021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:42021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:17.254853 16925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:17.256199 16925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:17.268409 16933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:17.268453 16934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:17.268487 16936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:17.269426 16925 server_base.cc:1034] running on GCE node
I20260808 14:56:17.270259 16925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:17.271672 16925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:17.272904 16925 hybrid_clock.cc:648] HybridClock initialized: now 1786200977272854 us; error 52 us; skew 500 ppm
I20260808 14:56:17.273305 16925 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:17 dist-test-slave-z8x9 krb5kdc[16905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200977, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:17.276576 16925 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:56:17.278117 16925 webserver.cc:460] Webserver started at http://127.12.73.190:37207/ using document root <none> and password file <none>
I20260808 14:56:17.278787 16925 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:17.278890 16925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:17.279153 16925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:17.282161 16925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "eeec1675e1794d168d7a84f0c32b6a4f"
format_stamp: "Formatted at 2026-08-08 14:56:17 on dist-test-slave-z8x9"
server_key: "9291463e96d0e1a60f1a899a7b681ef4"
server_key_iv: "1fd54e52c802624eeaab0c54b4861240"
server_key_version: "encryptionkey@0"
I20260808 14:56:17.282922 16925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "eeec1675e1794d168d7a84f0c32b6a4f"
format_stamp: "Formatted at 2026-08-08 14:56:17 on dist-test-slave-z8x9"
server_key: "9291463e96d0e1a60f1a899a7b681ef4"
server_key_iv: "1fd54e52c802624eeaab0c54b4861240"
server_key_version: "encryptionkey@0"
I20260808 14:56:17.288058 16925 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:56:17.291529 16948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:17.292850 16925 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 14:56:17.293033 16925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "eeec1675e1794d168d7a84f0c32b6a4f"
format_stamp: "Formatted at 2026-08-08 14:56:17 on dist-test-slave-z8x9"
server_key: "9291463e96d0e1a60f1a899a7b681ef4"
server_key_iv: "1fd54e52c802624eeaab0c54b4861240"
server_key_version: "encryptionkey@0"
I20260808 14:56:17.293277 16925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:17.310858 16925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:17.315155 16925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:17.315459 16925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:17.333724 16925 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:42021
I20260808 14:56:17.333755 17044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:42021 every 8 connection(s)
I20260808 14:56:17.335014 16925 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:17.338519 17045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:17.344821 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 16925
I20260808 14:56:17.345090 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:17.345970 12582 external_mini_cluster.cc:1428] Setting key b8bb6c14bcfacb8c2530a3b0514234de
I20260808 14:56:17.349826 17045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f: Bootstrap starting.
I20260808 14:56:17.352790 17045 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:17.353866 17045 log.cc:824] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:17.356957 17045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f: No bootstrap required, opened a new log
Aug 08 14:56:17 dist-test-slave-z8x9 krb5kdc[16905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:17.366030 17045 raft_consensus.cc:348] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeec1675e1794d168d7a84f0c32b6a4f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42021 } }
I20260808 14:56:17.366410 17045 raft_consensus.cc:374] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:17.366523 17045 raft_consensus.cc:729] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeec1675e1794d168d7a84f0c32b6a4f, State: Initialized, Role: FOLLOWER
I20260808 14:56:17.367137 17045 consensus_queue.cc:260] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeec1675e1794d168d7a84f0c32b6a4f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42021 } }
I20260808 14:56:17.367393 17045 raft_consensus.cc:388] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:17.367532 17045 raft_consensus.cc:482] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:17.367722 17045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:17.369316 17051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:17.348174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38128 (local address 127.12.73.190:42021)
0808 14:56:17.348939 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:17.348951 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:17.348989 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:56:17.350815 (+ 1826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:17.350836 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:17.351206 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:17.351608 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:17.353133 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:17.354744 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:17.356501 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:17.357265 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:17.357392 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:17.362080 (+ 4688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:17.362088 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:17.362102 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:17.362140 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:17.365335 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:17.365984 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:17.365992 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:17.366000 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:17.366182 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:17.366619 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:17.366625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:17.366628 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:17.367123 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:17.367440 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:17.367836 (+ 396us) server_negotiation.cc:299] Negotiation successful
0808 14:56:17.368248 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":344,"threads_started":1}
I20260808 14:56:17.370215 17045 raft_consensus.cc:504] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeec1675e1794d168d7a84f0c32b6a4f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42021 } }
I20260808 14:56:17.370718 17045 leader_election.cc:302] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eeec1675e1794d168d7a84f0c32b6a4f; no voters:
I20260808 14:56:17.371415 17045 leader_election.cc:288] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:17.371517 17053 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:17.372809 17053 raft_consensus.cc:686] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [term 1 LEADER]: Becoming Leader. State: Replica: eeec1675e1794d168d7a84f0c32b6a4f, State: Running, Role: LEADER
I20260808 14:56:17.373371 17053 consensus_queue.cc:237] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeec1675e1794d168d7a84f0c32b6a4f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42021 } }
I20260808 14:56:17.373569 17045 sys_catalog.cc:564] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:17.376462 17054 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eeec1675e1794d168d7a84f0c32b6a4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeec1675e1794d168d7a84f0c32b6a4f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42021 } } }
I20260808 14:56:17.376433 17055 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [sys.catalog]: SysCatalogTable state changed. Reason: New leader eeec1675e1794d168d7a84f0c32b6a4f. Latest consensus state: current_term: 1 leader_uuid: "eeec1675e1794d168d7a84f0c32b6a4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeec1675e1794d168d7a84f0c32b6a4f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42021 } } }
I20260808 14:56:17.376926 17054 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:17.376935 17055 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:17.379066 17063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:17.385506 17063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:17.393852 17063 catalog_manager.cc:1347] Generated new cluster ID: 9915653aa1d04520bbbd91992d5549b6
I20260808 14:56:17.393980 17063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:17.410364 17063 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:17.412206 17063 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:17.421504 17063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eeec1675e1794d168d7a84f0c32b6a4f: Generated new TSK 0
I20260808 14:56:17.422508 17063 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:56:17.476956 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:42021
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:35311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:17.804231 17090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:17.804518 17090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:17.804665 17090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:17.812047 17090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:17.812188 17090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:17.812358 17090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:56:17.822600 17090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:42021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:17.823942 17090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:17.825382 17090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:17.838891 17103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:17.838865 17104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:17.838819 17107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:17.839829 17090 server_base.cc:1034] running on GCE node
I20260808 14:56:17.840435 17090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:17.841437 17090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:17.842662 17090 hybrid_clock.cc:648] HybridClock initialized: now 1786200977842614 us; error 39 us; skew 500 ppm
I20260808 14:56:17.842986 17090 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:17 dist-test-slave-z8x9 krb5kdc[16905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200977, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:17.846364 17090 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:56:17.847847 17090 webserver.cc:460] Webserver started at http://127.12.73.129:41735/ using document root <none> and password file <none>
I20260808 14:56:17.848546 17090 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:17.848690 17090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:17.849009 17090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:17.852029 17090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "19c53213fe3c4f31a96b7dbcfb2b8674"
format_stamp: "Formatted at 2026-08-08 14:56:17 on dist-test-slave-z8x9"
server_key: "c255b7b727622d601002e3f1d55a4894"
server_key_iv: "f2539ffb6aa08e56bd6e563285535ab6"
server_key_version: "encryptionkey@0"
I20260808 14:56:17.852828 17090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "19c53213fe3c4f31a96b7dbcfb2b8674"
format_stamp: "Formatted at 2026-08-08 14:56:17 on dist-test-slave-z8x9"
server_key: "c255b7b727622d601002e3f1d55a4894"
server_key_iv: "f2539ffb6aa08e56bd6e563285535ab6"
server_key_version: "encryptionkey@0"
I20260808 14:56:17.858004 17090 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260808 14:56:17.861342 17118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:17.862567 17090 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:56:17.862740 17090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "19c53213fe3c4f31a96b7dbcfb2b8674"
format_stamp: "Formatted at 2026-08-08 14:56:17 on dist-test-slave-z8x9"
server_key: "c255b7b727622d601002e3f1d55a4894"
server_key_iv: "f2539ffb6aa08e56bd6e563285535ab6"
server_key_version: "encryptionkey@0"
I20260808 14:56:17.862942 17090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:17.884744 17090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:17.889149 17090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:17.889498 17090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:17.890439 17090 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:17.891780 17090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:17.891880 17090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:17.892019 17090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:17.892087 17090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:17.926386 17090 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:38485
I20260808 14:56:17.926476 17313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:38485 every 8 connection(s)
I20260808 14:56:17.927680 17090 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:56:17.936484 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 17090
I20260808 14:56:17.936734 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:56:17.937566 12582 external_mini_cluster.cc:1428] Setting key e87f9d9d0d48074a3a28c9dbff7062be
Aug 08 14:56:17 dist-test-slave-z8x9 krb5kdc[16905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200977, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:17.949713 17318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:17.930203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:54799 (local address 127.12.73.190:42021)
0808 14:56:17.930640 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:17.930645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:17.931478 (+ 833us) server_negotiation.cc:407] Connection header received
0808 14:56:17.933325 (+ 1847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:17.933331 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:17.933428 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:17.933545 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:17.934987 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:17.935692 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:17.938106 (+ 2414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:17.938705 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:17.938817 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:17.942667 (+ 3850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:17.942675 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:17.942682 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:17.942736 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:17.946484 (+ 3748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:17.947198 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:17.947207 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:17.947212 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:17.947370 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:17.947897 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:17.947901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:17.947903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:17.948155 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:17.948273 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:17.949232 (+ 959us) server_negotiation.cc:299] Negotiation successful
0808 14:56:17.949436 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":240,"threads_started":1}
I20260808 14:56:17.951097 17320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:17.930607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:42021 (local address 127.12.73.129:54799)
0808 14:56:17.931310 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:17.931349 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:17.933021 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:17.933767 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:17.933774 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:17.934290 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:17.934820 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:17.934836 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:17.935866 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:17.935870 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:17.937957 (+ 2087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:17.937973 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:17.938950 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:17.938957 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:17.939243 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:17.939995 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:17.940016 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:17.942452 (+ 2436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:17.946615 (+ 4163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:17.946621 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:17.946632 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:17.947065 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:17.947503 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:17.947510 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:17.947516 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:17.947768 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:17.948285 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:17.948295 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:17.948751 (+ 456us) client_negotiation.cc:769] Sending connection context
0808 14:56:17.949078 (+ 327us) client_negotiation.cc:240] Negotiation successful
0808 14:56:17.949707 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":266,"threads_started":1}
I20260808 14:56:17.952729 17315 heartbeater.cc:347] Connected to a master server at 127.12.73.190:42021
I20260808 14:56:17.953068 17315 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:17.953820 17315 heartbeater.cc:511] Master 127.12.73.190:42021 requested a full tablet report, sending...
I20260808 14:56:17.956087 16982 ts_manager.cc:194] Registered new tserver with Master: 19c53213fe3c4f31a96b7dbcfb2b8674 (127.12.73.129:38485)
I20260808 14:56:17.958392 16982 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:54799
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:56:17.988776 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:42021
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:35311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:18.317704 17326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:18.317991 17326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:18.318181 17326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:18.325306 17326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:18.325405 17326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:18.325611 17326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:56:18.336269 17326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:42021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:18.337757 17326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:18.339397 17326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:18.354692 17335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:18.354781 17334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:18.354710 17341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:18.355691 17326 server_base.cc:1034] running on GCE node
I20260808 14:56:18.356333 17326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:18.357388 17326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:18.358687 17326 hybrid_clock.cc:648] HybridClock initialized: now 1786200978358619 us; error 54 us; skew 500 ppm
I20260808 14:56:18.359040 17326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:18 dist-test-slave-z8x9 krb5kdc[16905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:18.362347 17326 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:56:18.363862 17326 webserver.cc:460] Webserver started at http://127.12.73.130:44875/ using document root <none> and password file <none>
I20260808 14:56:18.364552 17326 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:18.364694 17326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:18.365006 17326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:18.368036 17326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "953564ec52e24969b3e2cfc9c0bc4d1d"
format_stamp: "Formatted at 2026-08-08 14:56:18 on dist-test-slave-z8x9"
server_key: "616ce9537d9c4410c3c8a29f856aadca"
server_key_iv: "77564f0dc60d97b99c7e8090752f510c"
server_key_version: "encryptionkey@0"
I20260808 14:56:18.368811 17326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "953564ec52e24969b3e2cfc9c0bc4d1d"
format_stamp: "Formatted at 2026-08-08 14:56:18 on dist-test-slave-z8x9"
server_key: "616ce9537d9c4410c3c8a29f856aadca"
server_key_iv: "77564f0dc60d97b99c7e8090752f510c"
server_key_version: "encryptionkey@0"
I20260808 14:56:18.373811 17326 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260808 14:56:18.377152 17349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:18.378419 17326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:56:18.378588 17326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "953564ec52e24969b3e2cfc9c0bc4d1d"
format_stamp: "Formatted at 2026-08-08 14:56:18 on dist-test-slave-z8x9"
server_key: "616ce9537d9c4410c3c8a29f856aadca"
server_key_iv: "77564f0dc60d97b99c7e8090752f510c"
server_key_version: "encryptionkey@0"
I20260808 14:56:18.378780 17326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:18.396620 17326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:18.400946 17326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:18.401294 17326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:18.402201 17326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:18.403510 17326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:18.403610 17326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:18.403748 17326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:18.403824 17326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:18.437106 17326 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:35675
I20260808 14:56:18.437209 17540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:35675 every 8 connection(s)
I20260808 14:56:18.438426 17326 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:56:18.439739 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 17326
I20260808 14:56:18.439944 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:56:18.440488 12582 external_mini_cluster.cc:1428] Setting key 4b46c37957b66e3ae9e288b5af4087e0
Aug 08 14:56:18 dist-test-slave-z8x9 krb5kdc[16905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:18.458935 17318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:18.441147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:58115 (local address 127.12.73.190:42021)
0808 14:56:18.441354 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:18.441360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:18.442685 (+ 1325us) server_negotiation.cc:407] Connection header received
0808 14:56:18.444481 (+ 1796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:18.444487 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:18.444579 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:18.444684 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:18.446269 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:18.446977 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:18.448497 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:18.448928 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:18.449055 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:18.453248 (+ 4193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:18.453256 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:18.453261 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:18.453301 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:18.455907 (+ 2606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:18.456623 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:18.456633 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:18.456636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:18.456767 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:18.457240 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:18.457244 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:18.457246 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:18.457504 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:18.457657 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:18.458344 (+ 687us) server_negotiation.cc:299] Negotiation successful
0808 14:56:18.458576 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 14:56:18.459885 17546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:18.441686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:42021 (local address 127.12.73.130:58115)
0808 14:56:18.442512 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:18.442568 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:18.444221 (+ 1653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:18.444930 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:18.444938 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:18.445543 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:18.446094 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:18.446112 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:18.447121 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:18.447126 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:18.448356 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:18.448369 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:18.449192 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:18.449201 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:18.449537 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:18.450298 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:18.450335 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:18.452989 (+ 2654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:18.456049 (+ 3060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:18.456058 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:18.456072 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:18.456497 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:18.456889 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:18.456894 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:18.456897 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:18.457084 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:18.457631 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:18.457639 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:18.457969 (+ 330us) client_negotiation.cc:769] Sending connection context
0808 14:56:18.458225 (+ 256us) client_negotiation.cc:240] Negotiation successful
0808 14:56:18.458773 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":310,"threads_started":1}
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
I20260808 14:56:18.461417 17544 heartbeater.cc:347] Connected to a master server at 127.12.73.190:42021
I20260808 14:56:18.461709 17544 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:18.462420 17544 heartbeater.cc:511] Master 127.12.73.190:42021 requested a full tablet report, sending...
I20260808 14:56:18.463899 16982 ts_manager.cc:194] Registered new tserver with Master: 953564ec52e24969b3e2cfc9c0bc4d1d (127.12.73.130:35675)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
I20260808 14:56:18.465109 16982 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:58115
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:56:18.488307 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:42021
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:35311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:18.817564 17556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:18.817827 17556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:18.817920 17556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:18.824795 17556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:18.824895 17556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:18.825003 17556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:56:18.834128 17556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:42021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:18.835317 17556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:18.836608 17556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:18.849588 17568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:18.849699 17571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:18.849644 17567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:18.850132 17556 server_base.cc:1034] running on GCE node
I20260808 14:56:18.850818 17556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:18.851747 17556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:18.852983 17556 hybrid_clock.cc:648] HybridClock initialized: now 1786200978852931 us; error 46 us; skew 500 ppm
I20260808 14:56:18.853364 17556 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:18 dist-test-slave-z8x9 krb5kdc[16905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:18.856454 17556 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:56:18.858047 17556 webserver.cc:460] Webserver started at http://127.12.73.131:39503/ using document root <none> and password file <none>
I20260808 14:56:18.858884 17556 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:18.859021 17556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:18.859341 17556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:18.862264 17556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "010e8f889c5f40e083209c8b4d1a99d1"
format_stamp: "Formatted at 2026-08-08 14:56:18 on dist-test-slave-z8x9"
server_key: "e6da90d4ee5b50c1b8572b29e06c4264"
server_key_iv: "06788543c95ddfa963ae510b0683cbfb"
server_key_version: "encryptionkey@0"
I20260808 14:56:18.863041 17556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "010e8f889c5f40e083209c8b4d1a99d1"
format_stamp: "Formatted at 2026-08-08 14:56:18 on dist-test-slave-z8x9"
server_key: "e6da90d4ee5b50c1b8572b29e06c4264"
server_key_iv: "06788543c95ddfa963ae510b0683cbfb"
server_key_version: "encryptionkey@0"
I20260808 14:56:18.868155 17556 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:56:18.871592 17580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:18.872756 17556 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260808 14:56:18.872946 17556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "010e8f889c5f40e083209c8b4d1a99d1"
format_stamp: "Formatted at 2026-08-08 14:56:18 on dist-test-slave-z8x9"
server_key: "e6da90d4ee5b50c1b8572b29e06c4264"
server_key_iv: "06788543c95ddfa963ae510b0683cbfb"
server_key_version: "encryptionkey@0"
I20260808 14:56:18.873132 17556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:18.899647 17556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:18.903676 17556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:18.903998 17556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:18.905063 17556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:18.906504 17556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:18.906622 17556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:18.906780 17556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:18.906852 17556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:18.941670 17556 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:35385
I20260808 14:56:18.941727 17771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:35385 every 8 connection(s)
I20260808 14:56:18.942884 17556 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:56:18.947316 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 17556
I20260808 14:56:18.947523 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:56:18.947958 12582 external_mini_cluster.cc:1428] Setting key ccf0bafec4717aeb927d0103ca46684e
Aug 08 14:56:18 dist-test-slave-z8x9 krb5kdc[16905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:18.961483 17315 heartbeater.cc:503] Master 127.12.73.190:42021 was elected leader, sending a full tablet report...
I20260808 14:56:18.962342 17318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:18.945358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:35203 (local address 127.12.73.190:42021)
0808 14:56:18.945539 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:18.945544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:18.946675 (+ 1131us) server_negotiation.cc:407] Connection header received
0808 14:56:18.948569 (+ 1894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:18.948577 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:18.948694 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:18.948780 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:18.950541 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:18.951477 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:18.952930 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:18.953396 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:18.953487 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:18.956634 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:18.956639 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:18.956642 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:18.956674 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:18.959119 (+ 2445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:18.959806 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:18.959809 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:18.959812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:18.959937 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:18.960289 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:18.960292 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:18.960294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:18.960550 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:18.960681 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:18.961725 (+ 1044us) server_negotiation.cc:299] Negotiation successful
0808 14:56:18.961950 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:56:18.963516 17774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:18.945822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:42021 (local address 127.12.73.131:35203)
0808 14:56:18.946515 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:18.946559 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:18.948310 (+ 1751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:18.949057 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:18.949065 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:18.949703 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:18.950338 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:18.950355 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:18.951617 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:18.951621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:18.952810 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:18.952826 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:18.953569 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:18.953573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:18.953776 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:18.954383 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:18.954404 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:18.956466 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:18.959251 (+ 2785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:18.959257 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:18.959267 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:18.959697 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:18.960024 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:18.960027 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:18.960029 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:18.960197 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:18.960787 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:18.960794 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:18.961264 (+ 470us) client_negotiation.cc:769] Sending connection context
0808 14:56:18.961580 (+ 316us) client_negotiation.cc:240] Negotiation successful
0808 14:56:18.962125 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":267,"threads_started":1}
I20260808 14:56:18.964718 17772 heartbeater.cc:347] Connected to a master server at 127.12.73.190:42021
I20260808 14:56:18.965018 17772 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:18.965745 17772 heartbeater.cc:511] Master 127.12.73.190:42021 requested a full tablet report, sending...
I20260808 14:56:18.967056 16981 ts_manager.cc:194] Registered new tserver with Master: 010e8f889c5f40e083209c8b4d1a99d1 (127.12.73.131:35385)
I20260808 14:56:18.967832 16981 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:35203
I20260808 14:56:18.975423 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:56:19.010543 17318 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:56:19.008047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38142 (local address 127.12.73.190:42021)
0808 14:56:19.008309 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:19.008315 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:19.008557 (+ 242us) server_negotiation.cc:407] Connection header received
0808 14:56:19.008724 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:19.008728 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:19.008795 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:19.008883 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:19.010249 (+ 1366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38142: BlockingRecv error: recv got EOF from 127.0.0.1:38142 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
I20260808 14:56:19.013582 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17090
W20260808 14:56:19.016413 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17090: Not authorized: Client connection negotiation failed: client connection to 127.12.73.129:38485: server requires authentication, but client does not have Kerberos credentials available
I20260808 14:56:19.016593 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 17090
I20260808 14:56:19.045580 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17326
W20260808 14:56:19.048296 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17326: Not authorized: Client connection negotiation failed: client connection to 127.12.73.130:35675: server requires authentication, but client does not have Kerberos credentials available
I20260808 14:56:19.048489 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 17326
I20260808 14:56:19.073325 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17556
W20260808 14:56:19.076516 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17556: Not authorized: Client connection negotiation failed: client connection to 127.12.73.131:35385: server requires authentication, but client does not have Kerberos credentials available
I20260808 14:56:19.076678 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 17556
I20260808 14:56:19.098527 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16925
I20260808 14:56:19.099768 17035 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:19.204301 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 16925
2026-08-08T14:56:19Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3835 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:56:19 dist-test-slave-z8x9 krb5kdc[17795](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:56:19 dist-test-slave-z8x9 krb5kdc[17795](info): set up 2 sockets
Aug 08 14:56:19 dist-test-slave-z8x9 krb5kdc[17795](info): commencing operation
krb5kdc: starting...
W20260808 14:56:20.529036 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.002s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:56:20 dist-test-slave-z8x9 krb5kdc[17795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:56:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:56:20.744451 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33555
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:42079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:33555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:21.088544 17824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:21.088847 17824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:21.089001 17824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:21.096757 17824 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:21.096872 17824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:21.097000 17824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:21.097092 17824 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:21.097234 17824 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:21.108223 17824 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:42079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:33555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:21.109614 17824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:21.110917 17824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:21.122414 17834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:21.122502 17830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:21.122471 17831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:21.123581 17824 server_base.cc:1034] running on GCE node
I20260808 14:56:21.124411 17824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:21.125864 17824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:21.127071 17824 hybrid_clock.cc:648] HybridClock initialized: now 1786200981127018 us; error 40 us; skew 500 ppm
I20260808 14:56:21.127466 17824 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:21 dist-test-slave-z8x9 krb5kdc[17795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200981, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:21.130806 17824 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:56:21.132277 17824 webserver.cc:460] Webserver started at http://127.12.73.190:44437/ using document root <none> and password file <none>
I20260808 14:56:21.132938 17824 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:21.133085 17824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:21.133430 17824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:21.136345 17824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "6792cb1c17894382b4f6a77b7a30247f"
format_stamp: "Formatted at 2026-08-08 14:56:21 on dist-test-slave-z8x9"
server_key: "535c4bbc1ae2ad12a43a89f08e1f9337"
server_key_iv: "f88e36a1d86e10622750307159e4337e"
server_key_version: "encryptionkey@0"
I20260808 14:56:21.137162 17824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "6792cb1c17894382b4f6a77b7a30247f"
format_stamp: "Formatted at 2026-08-08 14:56:21 on dist-test-slave-z8x9"
server_key: "535c4bbc1ae2ad12a43a89f08e1f9337"
server_key_iv: "f88e36a1d86e10622750307159e4337e"
server_key_version: "encryptionkey@0"
I20260808 14:56:21.142098 17824 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:56:21.145490 17849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:21.146709 17824 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:56:21.146891 17824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "6792cb1c17894382b4f6a77b7a30247f"
format_stamp: "Formatted at 2026-08-08 14:56:21 on dist-test-slave-z8x9"
server_key: "535c4bbc1ae2ad12a43a89f08e1f9337"
server_key_iv: "f88e36a1d86e10622750307159e4337e"
server_key_version: "encryptionkey@0"
I20260808 14:56:21.147081 17824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:21.159490 17824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:21.163352 17824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:21.163626 17824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:21.181874 17824 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:33555
I20260808 14:56:21.181905 17931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:33555 every 8 connection(s)
I20260808 14:56:21.183252 17824 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:21.185899 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 17824
I20260808 14:56:21.186141 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:21.186806 12582 external_mini_cluster.cc:1428] Setting key 7976619630c887388e10a3daa435b91d
I20260808 14:56:21.187144 17933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:21.201696 17933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f: Bootstrap starting.
Aug 08 14:56:21 dist-test-slave-z8x9 krb5kdc[17795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:21.205394 17933 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:21.206492 17933 log.cc:824] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:21.209728 17933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f: No bootstrap required, opened a new log
I20260808 14:56:21.210908 17937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:21.188629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57108 (local address 127.12.73.190:33555)
0808 14:56:21.189531 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:21.189548 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:21.189601 (+ 53us) server_negotiation.cc:407] Connection header received
0808 14:56:21.192046 (+ 2445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:21.192076 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:21.192581 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:21.193039 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:21.194553 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:21.196531 (+ 1978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:21.197852 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:21.198970 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:21.199169 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:21.203496 (+ 4327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:21.203507 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:21.203520 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:21.203564 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:21.206750 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:21.207541 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:21.207549 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:21.207557 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:21.207766 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:21.208268 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:21.208272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:21.208274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:21.208848 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:21.209080 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:21.209597 (+ 517us) server_negotiation.cc:299] Negotiation successful
0808 14:56:21.209976 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":443,"threads_started":1}
I20260808 14:56:21.214605 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:56:21.217526 17933 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6792cb1c17894382b4f6a77b7a30247f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33555 } }
I20260808 14:56:21.217868 17933 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:21.217983 17933 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6792cb1c17894382b4f6a77b7a30247f, State: Initialized, Role: FOLLOWER
I20260808 14:56:21.218520 17933 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6792cb1c17894382b4f6a77b7a30247f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33555 } }
I20260808 14:56:21.218765 17933 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:21.218907 17933 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:21.219079 17933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:21.221277 17933 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6792cb1c17894382b4f6a77b7a30247f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33555 } }
I20260808 14:56:21.221788 17933 leader_election.cc:302] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6792cb1c17894382b4f6a77b7a30247f; no voters:
I20260808 14:56:21.222384 17933 leader_election.cc:288] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:21.222543 17941 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:21.223431 17941 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [term 1 LEADER]: Becoming Leader. State: Replica: 6792cb1c17894382b4f6a77b7a30247f, State: Running, Role: LEADER
I20260808 14:56:21.223958 17941 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6792cb1c17894382b4f6a77b7a30247f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33555 } }
I20260808 14:56:21.224721 17933 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:21.227639 17945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6792cb1c17894382b4f6a77b7a30247f. Latest consensus state: current_term: 1 leader_uuid: "6792cb1c17894382b4f6a77b7a30247f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6792cb1c17894382b4f6a77b7a30247f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33555 } } }
I20260808 14:56:21.228024 17945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:21.228564 17943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6792cb1c17894382b4f6a77b7a30247f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6792cb1c17894382b4f6a77b7a30247f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33555 } } }
I20260808 14:56:21.228915 17943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:21.236060 17956 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:21.241268 17956 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:21.254578 17956 catalog_manager.cc:1347] Generated new cluster ID: 90614ee2e3e34f35a246dece8b6e8c34
I20260808 14:56:21.254835 17956 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:21.276355 17978 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:56:21.284418 17956 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:21.286290 17956 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:21.288424 17937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:21.279327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57124 (local address 127.12.73.190:33555)
0808 14:56:21.279527 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:21.279534 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:21.280133 (+ 599us) server_negotiation.cc:407] Connection header received
0808 14:56:21.280329 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:21.280334 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:21.280426 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:21.280544 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:21.281971 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:21.282713 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:21.284187 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:21.284903 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:21.285013 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:21.286548 (+ 1535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:21.286558 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:21.286563 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:21.287427 (+ 864us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:21.287504 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:21.287545 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:21.287669 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:21.287933 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 14:56:21.288067 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 14:56:21.302222 17956 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6792cb1c17894382b4f6a77b7a30247f: Generated new TSK 0
I20260808 14:56:21.303226 17956 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:56:21.317772 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17824
I20260808 14:56:21.318951 17923 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:21.410722 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 17824
2026-08-08T14:56:21Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2200 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:56:21 dist-test-slave-z8x9 krb5kdc[17988](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:56:21 dist-test-slave-z8x9 krb5kdc[17988](info): set up 2 sockets
Aug 08 14:56:21 dist-test-slave-z8x9 krb5kdc[17988](info): commencing operation
krb5kdc: starting...
W20260808 14:56:22.736953 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.001s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:56:22 dist-test-slave-z8x9 krb5kdc[17988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:56:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:56:22.954353 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:41383
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:41383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:23.280938 18010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:23.281304 18010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:23.281453 18010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:23.288555 18010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:23.288655 18010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:23.288764 18010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:23.288862 18010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:23.288942 18010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:23.298676 18010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:41383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:41383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:23.299990 18010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:23.301333 18010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:23.312978 18020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:23.313017 18026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:23.313050 18021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:23.314438 18010 server_base.cc:1034] running on GCE node
I20260808 14:56:23.315198 18010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:23.316650 18010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:23.317885 18010 hybrid_clock.cc:648] HybridClock initialized: now 1786200983317827 us; error 44 us; skew 500 ppm
I20260808 14:56:23.318228 18010 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:23 dist-test-slave-z8x9 krb5kdc[17988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200983, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:23.321298 18010 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:56:23.322656 18010 webserver.cc:460] Webserver started at http://127.12.73.190:39133/ using document root <none> and password file <none>
I20260808 14:56:23.323364 18010 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:23.323508 18010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:23.323819 18010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:23.326776 18010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "bbc2554fa8934659986839dc95e66fb9"
format_stamp: "Formatted at 2026-08-08 14:56:23 on dist-test-slave-z8x9"
server_key: "85490aaf96d7a0423b1209e345af33f2"
server_key_iv: "765226cf9713b2dc0e938f8fad2a13a9"
server_key_version: "encryptionkey@0"
I20260808 14:56:23.327538 18010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "bbc2554fa8934659986839dc95e66fb9"
format_stamp: "Formatted at 2026-08-08 14:56:23 on dist-test-slave-z8x9"
server_key: "85490aaf96d7a0423b1209e345af33f2"
server_key_iv: "765226cf9713b2dc0e938f8fad2a13a9"
server_key_version: "encryptionkey@0"
I20260808 14:56:23.332774 18010 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:56:23.336239 18036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:23.337638 18010 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 14:56:23.337826 18010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "bbc2554fa8934659986839dc95e66fb9"
format_stamp: "Formatted at 2026-08-08 14:56:23 on dist-test-slave-z8x9"
server_key: "85490aaf96d7a0423b1209e345af33f2"
server_key_iv: "765226cf9713b2dc0e938f8fad2a13a9"
server_key_version: "encryptionkey@0"
I20260808 14:56:23.338019 18010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:23.359978 18010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:23.364188 18010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:23.364494 18010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:23.383168 18010 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:41383
I20260808 14:56:23.383205 18111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:41383 every 8 connection(s)
I20260808 14:56:23.384604 18010 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:23.388190 18116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:23.394799 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 18010
I20260808 14:56:23.395013 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:23.395632 12582 external_mini_cluster.cc:1428] Setting key af632085bcfd8a68113823c96f8519d8
I20260808 14:56:23.399475 18116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9: Bootstrap starting.
I20260808 14:56:23.403196 18116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:23.404371 18116 log.cc:824] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:23.407200 18116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9: No bootstrap required, opened a new log
Aug 08 14:56:23 dist-test-slave-z8x9 krb5kdc[17988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:23.414820 18116 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc2554fa8934659986839dc95e66fb9" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41383 } }
I20260808 14:56:23.415189 18116 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:23.415298 18116 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbc2554fa8934659986839dc95e66fb9, State: Initialized, Role: FOLLOWER
I20260808 14:56:23.415962 18116 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc2554fa8934659986839dc95e66fb9" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41383 } }
I20260808 14:56:23.416283 18116 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:23.416455 18116 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:23.416642 18116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:23.419364 18121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:23.397758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41132 (local address 127.12.73.190:41383)
0808 14:56:23.398538 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:23.398553 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:23.398602 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:56:23.401048 (+ 2446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:23.401085 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:23.401627 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:23.402043 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:23.403422 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:23.404888 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:23.406274 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:23.406960 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:23.407157 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:23.411214 (+ 4057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:23.411223 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:23.411237 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:23.411283 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:23.414644 (+ 3361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:23.415429 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:23.415438 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:23.415447 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:23.415658 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:23.416065 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:23.416070 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:23.416073 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:23.416846 (+ 773us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:23.417223 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:23.417528 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 14:56:23.417996 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":340,"threads_started":1}
I20260808 14:56:23.419999 18116 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc2554fa8934659986839dc95e66fb9" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41383 } }
I20260808 14:56:23.420485 18116 leader_election.cc:302] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbc2554fa8934659986839dc95e66fb9; no voters:
I20260808 14:56:23.421052 18116 leader_election.cc:288] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:23.421264 18125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:23.422458 18125 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [term 1 LEADER]: Becoming Leader. State: Replica: bbc2554fa8934659986839dc95e66fb9, State: Running, Role: LEADER
I20260808 14:56:23.423134 18116 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:23.423107 18125 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc2554fa8934659986839dc95e66fb9" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41383 } }
I20260808 14:56:23.426064 18126 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbc2554fa8934659986839dc95e66fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc2554fa8934659986839dc95e66fb9" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41383 } } }
I20260808 14:56:23.426426 18126 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:23.426630 18129 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbc2554fa8934659986839dc95e66fb9. Latest consensus state: current_term: 1 leader_uuid: "bbc2554fa8934659986839dc95e66fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc2554fa8934659986839dc95e66fb9" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41383 } } }
I20260808 14:56:23.427012 18129 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9 [sys.catalog]: This master's current role is: LEADER
W20260808 14:56:23.435231 18149 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:56:23.435364 18149 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:56:23.435501 18139 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:23.437326 18139 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:23.444902 18139 catalog_manager.cc:1347] Generated new cluster ID: 93172b093d994550a2a7c4de2bfb6b69
I20260808 14:56:23.445013 18139 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:23.458238 18139 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:23.460022 18139 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:23.474121 18139 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbc2554fa8934659986839dc95e66fb9: Generated new TSK 0
I20260808 14:56:23.475199 18139 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:56:23.529932 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:41383
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:23.864709 18158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:23.865042 18158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:23.865250 18158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:23.872541 18158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:23.872680 18158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:23.872866 18158 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:56:23.882686 18158 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:41383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:23.883936 18158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:23.885301 18158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:23.898283 18163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:23.898234 18165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:23.898294 18167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:23.899370 18158 server_base.cc:1034] running on GCE node
I20260808 14:56:23.899953 18158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:23.900857 18158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:23.902076 18158 hybrid_clock.cc:648] HybridClock initialized: now 1786200983902040 us; error 44 us; skew 500 ppm
I20260808 14:56:23.902383 18158 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:23 dist-test-slave-z8x9 krb5kdc[17988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200983, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:23.905656 18158 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:56:23.907020 18158 webserver.cc:460] Webserver started at http://127.12.73.129:33611/ using document root <none> and password file <none>
I20260808 14:56:23.907677 18158 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:23.907825 18158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:23.908123 18158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:23.910985 18158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "0092dfa72d4849d0908203790e7039ca"
format_stamp: "Formatted at 2026-08-08 14:56:23 on dist-test-slave-z8x9"
server_key: "b8ae149a1e8a3ace537cf2f9e3a8adc6"
server_key_iv: "8a2237c7a5ce46e1023fdcf7b3818ed2"
server_key_version: "encryptionkey@0"
I20260808 14:56:23.911759 18158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "0092dfa72d4849d0908203790e7039ca"
format_stamp: "Formatted at 2026-08-08 14:56:23 on dist-test-slave-z8x9"
server_key: "b8ae149a1e8a3ace537cf2f9e3a8adc6"
server_key_iv: "8a2237c7a5ce46e1023fdcf7b3818ed2"
server_key_version: "encryptionkey@0"
I20260808 14:56:23.916741 18158 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 14:56:23.920251 18180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:23.921566 18158 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:23.921729 18158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "0092dfa72d4849d0908203790e7039ca"
format_stamp: "Formatted at 2026-08-08 14:56:23 on dist-test-slave-z8x9"
server_key: "b8ae149a1e8a3ace537cf2f9e3a8adc6"
server_key_iv: "8a2237c7a5ce46e1023fdcf7b3818ed2"
server_key_version: "encryptionkey@0"
I20260808 14:56:23.921928 18158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:23.938401 18158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:23.943029 18158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:23.943320 18158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:23.944265 18158 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:23.945658 18158 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:23.945739 18158 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:23.945847 18158 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:23.945907 18158 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:23.979478 18158 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:36753
I20260808 14:56:23.979622 18365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:36753 every 8 connection(s)
I20260808 14:56:23.980804 18158 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:56:23.982327 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 18158
I20260808 14:56:23.982542 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:56:23.983343 12582 external_mini_cluster.cc:1428] Setting key 92843eb034a010e47956d8d3c98287ec
Aug 08 14:56:23 dist-test-slave-z8x9 krb5kdc[17988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200983, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:24.004892 18371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:23.983695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:41503 (local address 127.12.73.190:41383)
0808 14:56:23.984223 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:23.984229 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:23.987145 (+ 2916us) server_negotiation.cc:407] Connection header received
0808 14:56:23.987212 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:23.987216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:23.987276 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:23.987357 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:23.989653 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:23.990382 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:23.992911 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:23.993430 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:23.993532 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:23.997298 (+ 3766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:23.997308 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:23.997317 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:23.997381 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:24.001206 (+ 3825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:24.001992 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:24.002000 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:24.002007 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:24.002163 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:24.002661 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:24.002669 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:24.002675 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:24.003087 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:24.003264 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:24.004122 (+ 858us) server_negotiation.cc:299] Negotiation successful
0808 14:56:24.004382 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":262,"threads_started":1}
I20260808 14:56:24.005755 18372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:23.984233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:41383 (local address 127.12.73.129:41503)
0808 14:56:23.985086 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:23.985137 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:23.986884 (+ 1747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:23.987707 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:23.987721 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:23.988547 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:23.989438 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:23.989468 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:23.990557 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:23.990565 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:23.992691 (+ 2126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:23.992709 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:23.993667 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:23.993677 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:23.993984 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:23.994735 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:23.994758 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:23.997028 (+ 2270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:24.001353 (+ 4325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:24.001361 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:24.001374 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:24.001853 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:24.002295 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:24.002299 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:24.002301 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:24.002515 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:24.003245 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:24.003251 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:24.003591 (+ 340us) client_negotiation.cc:769] Sending connection context
0808 14:56:24.003963 (+ 372us) client_negotiation.cc:240] Negotiation successful
0808 14:56:24.004416 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":311,"threads_started":1}
I20260808 14:56:24.007578 18366 heartbeater.cc:347] Connected to a master server at 127.12.73.190:41383
I20260808 14:56:24.007969 18366 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
I20260808 14:56:24.008998 18366 heartbeater.cc:511] Master 127.12.73.190:41383 requested a full tablet report, sending...
I20260808 14:56:24.011426 18057 ts_manager.cc:194] Registered new tserver with Master: 0092dfa72d4849d0908203790e7039ca (127.12.73.129:36753)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
I20260808 14:56:24.013101 18057 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:41503
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:56:24.039790 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:41383
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:24.394272 18376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:24.394678 18376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:24.394832 18376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:24.407874 18376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:24.408020 18376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:24.408226 18376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:56:24.419023 18376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:41383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:24.420231 18376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:24.421559 18376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:24.435060 18386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:24.435089 18391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:24.435251 18382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:24.435839 18376 server_base.cc:1034] running on GCE node
I20260808 14:56:24.436465 18376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:24.437507 18376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:24.438733 18376 hybrid_clock.cc:648] HybridClock initialized: now 1786200984438689 us; error 42 us; skew 500 ppm
I20260808 14:56:24.439043 18376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:24 dist-test-slave-z8x9 krb5kdc[17988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200984, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:24.442304 18376 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:56:24.443810 18376 webserver.cc:460] Webserver started at http://127.12.73.130:35607/ using document root <none> and password file <none>
I20260808 14:56:24.444484 18376 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:24.444636 18376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:24.444957 18376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:24.447860 18376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "e2a39e77e3a84faca05cff6026ab886f"
format_stamp: "Formatted at 2026-08-08 14:56:24 on dist-test-slave-z8x9"
server_key: "69ab19e55d2e4610e3f32e9e5276fc27"
server_key_iv: "9f18bd9e8cbab5758f3f62feeebd4075"
server_key_version: "encryptionkey@0"
I20260808 14:56:24.448639 18376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "e2a39e77e3a84faca05cff6026ab886f"
format_stamp: "Formatted at 2026-08-08 14:56:24 on dist-test-slave-z8x9"
server_key: "69ab19e55d2e4610e3f32e9e5276fc27"
server_key_iv: "9f18bd9e8cbab5758f3f62feeebd4075"
server_key_version: "encryptionkey@0"
I20260808 14:56:24.453754 18376 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260808 14:56:24.457268 18402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:24.458534 18376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:56:24.458712 18376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "e2a39e77e3a84faca05cff6026ab886f"
format_stamp: "Formatted at 2026-08-08 14:56:24 on dist-test-slave-z8x9"
server_key: "69ab19e55d2e4610e3f32e9e5276fc27"
server_key_iv: "9f18bd9e8cbab5758f3f62feeebd4075"
server_key_version: "encryptionkey@0"
I20260808 14:56:24.458927 18376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:24.479424 18376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:24.483382 18376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:24.483671 18376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:24.484601 18376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:24.485958 18376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:24.486065 18376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:24.486202 18376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:24.486272 18376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:24.520679 18376 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:39169
I20260808 14:56:24.520726 18585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:39169 every 8 connection(s)
I20260808 14:56:24.522061 18376 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:56:24.522927 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 18376
I20260808 14:56:24.523124 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:56:24.523710 12582 external_mini_cluster.cc:1428] Setting key 438133cf77046c3ac9d904b4785cd60d
Aug 08 14:56:24 dist-test-slave-z8x9 krb5kdc[17988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200984, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:24.543911 18588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:24.525000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:47709 (local address 127.12.73.190:41383)
0808 14:56:24.525547 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:24.525554 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:24.526656 (+ 1102us) server_negotiation.cc:407] Connection header received
0808 14:56:24.528539 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:24.528549 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:24.528641 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:24.528765 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:24.530394 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:24.531570 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:24.533056 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:24.533828 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:24.533973 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:24.537863 (+ 3890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:24.537868 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:24.537872 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:24.537903 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:24.540620 (+ 2717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:24.541496 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:24.541500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:24.541503 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:24.541625 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:24.542056 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:24.542062 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:24.542064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:24.542406 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:24.542593 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:24.543305 (+ 712us) server_negotiation.cc:299] Negotiation successful
0808 14:56:24.543553 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":317,"threads_started":1}
I20260808 14:56:24.544863 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:24.525605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:41383 (local address 127.12.73.130:47709)
0808 14:56:24.526475 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:24.526548 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:24.528247 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:24.528967 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:24.528974 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:24.529628 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:24.530227 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:24.530244 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:24.531708 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:24.531711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:24.532911 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:24.532922 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:24.534028 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:24.534033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:24.534340 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:24.535112 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:24.535152 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:24.537633 (+ 2481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:24.540764 (+ 3131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:24.540773 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:24.540788 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:24.541361 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:24.541736 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:24.541741 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:24.541745 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:24.541935 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:24.542563 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:24.542571 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:24.542923 (+ 352us) client_negotiation.cc:769] Sending connection context
0808 14:56:24.543188 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 14:56:24.543712 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":412,"threads_started":1}
I20260808 14:56:24.546344 18586 heartbeater.cc:347] Connected to a master server at 127.12.73.190:41383
I20260808 14:56:24.546689 18586 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
I20260808 14:56:24.547617 18586 heartbeater.cc:511] Master 127.12.73.190:41383 requested a full tablet report, sending...
I20260808 14:56:24.549332 18057 ts_manager.cc:194] Registered new tserver with Master: e2a39e77e3a84faca05cff6026ab886f (127.12.73.130:39169)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
I20260808 14:56:24.550364 18057 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:47709
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:56:24.574482 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:41383
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:24.911711 18594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:24.911975 18594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:24.912173 18594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:24.919405 18594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:24.919534 18594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:24.919716 18594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:56:24.929656 18594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:41383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:24.930920 18594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:24.932216 18594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:24.946265 18610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:24.946200 18606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:24.946303 18605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:24.947256 18594 server_base.cc:1034] running on GCE node
I20260808 14:56:24.947885 18594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:24.948776 18594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:24.950003 18594 hybrid_clock.cc:648] HybridClock initialized: now 1786200984949967 us; error 54 us; skew 500 ppm
I20260808 14:56:24.950321 18594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:24 dist-test-slave-z8x9 krb5kdc[17988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200984, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:24.953434 18594 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:56:24.954895 18594 webserver.cc:460] Webserver started at http://127.12.73.131:38909/ using document root <none> and password file <none>
I20260808 14:56:24.955505 18594 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:24.955608 18594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:24.955864 18594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:24.958717 18594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "9f0c27a41bf94080b0fc208232a4bbc4"
format_stamp: "Formatted at 2026-08-08 14:56:24 on dist-test-slave-z8x9"
server_key: "1e6c9181a4d9339ec3b3ce874479a216"
server_key_iv: "00594e9bf35676387d88b824e0f54f8c"
server_key_version: "encryptionkey@0"
I20260808 14:56:24.959427 18594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "9f0c27a41bf94080b0fc208232a4bbc4"
format_stamp: "Formatted at 2026-08-08 14:56:24 on dist-test-slave-z8x9"
server_key: "1e6c9181a4d9339ec3b3ce874479a216"
server_key_iv: "00594e9bf35676387d88b824e0f54f8c"
server_key_version: "encryptionkey@0"
I20260808 14:56:24.964386 18594 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:56:24.967680 18624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:24.968938 18594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:56:24.969106 18594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "9f0c27a41bf94080b0fc208232a4bbc4"
format_stamp: "Formatted at 2026-08-08 14:56:24 on dist-test-slave-z8x9"
server_key: "1e6c9181a4d9339ec3b3ce874479a216"
server_key_iv: "00594e9bf35676387d88b824e0f54f8c"
server_key_version: "encryptionkey@0"
I20260808 14:56:24.969353 18594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:24.987514 18594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:24.991569 18594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:24.991884 18594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:24.992847 18594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:24.994236 18594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:24.994313 18594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:24.994494 18594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:24.994545 18594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:25.016224 18366 heartbeater.cc:503] Master 127.12.73.190:41383 was elected leader, sending a full tablet report...
I20260808 14:56:25.029036 18594 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:39963
I20260808 14:56:25.029071 18810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:39963 every 8 connection(s)
I20260808 14:56:25.030450 18594 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:56:25.036375 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 18594
I20260808 14:56:25.036574 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:56:25.037031 12582 external_mini_cluster.cc:1428] Setting key 3446bbab8ef319b4e999e4ad6e53883c
Aug 08 14:56:25 dist-test-slave-z8x9 krb5kdc[17988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200984, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:25.051934 18588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:25.032885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:37367 (local address 127.12.73.190:41383)
0808 14:56:25.033061 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:25.033066 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:25.034292 (+ 1226us) server_negotiation.cc:407] Connection header received
0808 14:56:25.036074 (+ 1782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:25.036080 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:25.036189 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:25.036309 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:25.038118 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:25.039216 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:25.041318 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:25.041716 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:25.041814 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:25.045866 (+ 4052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:25.045875 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:25.045879 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:25.045924 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:25.048740 (+ 2816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:25.049559 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:25.049564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:25.049568 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:25.049697 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:25.050149 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:25.050154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:25.050157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:25.050436 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:25.050625 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:25.051369 (+ 744us) server_negotiation.cc:299] Negotiation successful
0808 14:56:25.051590 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:56:25.052906 18813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:25.033452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:41383 (local address 127.12.73.131:37367)
0808 14:56:25.034144 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:25.034180 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:25.035818 (+ 1638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:25.036585 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:25.036593 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:25.037252 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:25.037928 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:25.037967 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:25.039396 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:25.039402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:25.041066 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:25.041079 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:25.041909 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:25.041914 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:25.042110 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:25.042774 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:25.042801 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:25.045644 (+ 2843us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:25.048898 (+ 3254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:25.048907 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:25.048920 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:25.049418 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:25.049808 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:25.049812 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:25.049816 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:25.050025 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:25.050592 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:25.050599 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:25.050941 (+ 342us) client_negotiation.cc:769] Sending connection context
0808 14:56:25.051276 (+ 335us) client_negotiation.cc:240] Negotiation successful
0808 14:56:25.051773 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":278,"threads_started":1}
I20260808 14:56:25.054160 18811 heartbeater.cc:347] Connected to a master server at 127.12.73.190:41383
I20260808 14:56:25.054502 18811 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:25.055343 18811 heartbeater.cc:511] Master 127.12.73.190:41383 requested a full tablet report, sending...
I20260808 14:56:25.056725 18057 ts_manager.cc:194] Registered new tserver with Master: 9f0c27a41bf94080b0fc208232a4bbc4 (127.12.73.131:39963)
I20260808 14:56:25.057559 18057 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:37367
I20260808 14:56:25.064776 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:56:25 dist-test-slave-z8x9 krb5kdc[17988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200985, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 14:56:25 dist-test-slave-z8x9 krb5kdc[17988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200985, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:25.117264 18588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:25.103561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41142 (local address 127.12.73.190:41383)
0808 14:56:25.103735 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:25.103740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:25.104195 (+ 455us) server_negotiation.cc:407] Connection header received
0808 14:56:25.104365 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:25.104369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:25.104468 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:25.104563 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:25.105974 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:25.106703 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:25.107971 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:25.108441 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:25.108540 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:25.112354 (+ 3814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:25.112359 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:25.112362 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:25.112394 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:25.114907 (+ 2513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:25.115546 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:25.115550 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:25.115552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:25.115686 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:25.116000 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:25.116003 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:25.116005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:25.116313 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:25.116512 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:25.116779 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 14:56:25.116946 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 14:56:25.117836 18057 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41142
I20260808 14:56:25.119388 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 18158
Aug 08 14:56:25 dist-test-slave-z8x9 krb5kdc[17988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200985, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:56:25.135203 18827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:25.120666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60186 (local address 127.12.73.129:36753)
0808 14:56:25.121376 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:25.121382 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:25.121406 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:56:25.121459 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:25.121465 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:25.121672 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:25.121799 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:25.122794 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:25.123887 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:25.125129 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:25.125843 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:25.125940 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:25.129823 (+ 3883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:25.129834 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:25.129846 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:25.129875 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:25.132884 (+ 3009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:25.133535 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:25.133542 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:25.133544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:25.133662 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:25.134004 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:25.134008 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:25.134009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:25.134321 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:25.134540 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:25.134735 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 14:56:25.134923 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":379,"threads_started":1}
W20260808 14:56:25.136426 18358 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60186
W20260808 14:56:25.137578 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 18158: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:56:25.137784 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 18158
I20260808 14:56:25.168763 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 18376
Aug 08 14:56:25 dist-test-slave-z8x9 krb5kdc[17988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200985, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:56:25.184442 18829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:25.169640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43720 (local address 127.12.73.130:39169)
0808 14:56:25.170255 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:25.170262 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:25.170288 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:56:25.170352 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:25.170358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:25.170562 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:25.170701 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:25.171896 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:25.172985 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:25.174328 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:25.174867 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:25.174965 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:25.179104 (+ 4139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:25.179115 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:25.179131 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:25.179171 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:25.181998 (+ 2827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:25.182658 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:25.182665 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:25.182667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:25.182798 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:25.183117 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:25.183120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:25.183122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:25.183463 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:25.183693 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:25.183921 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 14:56:25.184123 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":319,"threads_started":1}
W20260808 14:56:25.185756 18579 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:43720
W20260808 14:56:25.186829 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 18376: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:56:25.187005 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 18376
I20260808 14:56:25.212271 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 18594
Aug 08 14:56:25 dist-test-slave-z8x9 krb5kdc[17988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200985, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:56:25.228518 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:25.213320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57242 (local address 127.12.73.131:39963)
0808 14:56:25.213958 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:25.213965 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:25.213993 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:56:25.214056 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:25.214062 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:25.214286 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:25.214414 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:25.215712 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:25.216766 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:25.218057 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:25.218619 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:25.218717 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:25.222988 (+ 4271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:25.222999 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:25.223013 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:25.223046 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:25.226019 (+ 2973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:25.226653 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:25.226660 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:25.226662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:25.226780 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:25.227086 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:25.227089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:25.227091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:25.227455 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:25.227691 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:25.227947 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 14:56:25.228181 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":309,"threads_started":1}
W20260808 14:56:25.229979 18796 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57242
W20260808 14:56:25.231048 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 18594: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:56:25.231233 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 18594
I20260808 14:56:25.255466 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 18010
I20260808 14:56:25.256683 18105 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:25.361649 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 18010
2026-08-08T14:56:25Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3953 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:56:25 dist-test-slave-z8x9 krb5kdc[18835](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:56:25 dist-test-slave-z8x9 krb5kdc[18835](info): set up 2 sockets
Aug 08 14:56:25 dist-test-slave-z8x9 krb5kdc[18835](info): commencing operation
krb5kdc: starting...
W20260808 14:56:26.675998 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.001s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:56:26 dist-test-slave-z8x9 krb5kdc[18835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200986, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:56:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:56:26.897101 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36143
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:45333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:36143
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:27.225773 18861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:27.226145 18861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:27.226305 18861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:27.233450 18861 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:27.233599 18861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:27.233709 18861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:27.233809 18861 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:27.233894 18861 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:27.243465 18861 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:36143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:27.244771 18861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:27.246086 18861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:27.258172 18871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:27.258332 18868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:27.258515 18867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:27.259289 18861 server_base.cc:1034] running on GCE node
I20260808 14:56:27.260125 18861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:27.261612 18861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:27.262853 18861 hybrid_clock.cc:648] HybridClock initialized: now 1786200987262818 us; error 50 us; skew 500 ppm
I20260808 14:56:27.263191 18861 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:27 dist-test-slave-z8x9 krb5kdc[18835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200987, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:27.270671 18861 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:56:27.272133 18861 webserver.cc:460] Webserver started at http://127.12.73.190:35577/ using document root <none> and password file <none>
I20260808 14:56:27.272800 18861 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:27.272902 18861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:27.273232 18861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:27.276180 18861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "a96d5eb9d2bc435db87f28d81240ccd7"
format_stamp: "Formatted at 2026-08-08 14:56:27 on dist-test-slave-z8x9"
server_key: "229b2ae1579a9ee82a96337c12ba7ea5"
server_key_iv: "250e673a9e31bacf0a55e67a96a08125"
server_key_version: "encryptionkey@0"
I20260808 14:56:27.276998 18861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "a96d5eb9d2bc435db87f28d81240ccd7"
format_stamp: "Formatted at 2026-08-08 14:56:27 on dist-test-slave-z8x9"
server_key: "229b2ae1579a9ee82a96337c12ba7ea5"
server_key_iv: "250e673a9e31bacf0a55e67a96a08125"
server_key_version: "encryptionkey@0"
I20260808 14:56:27.282217 18861 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:56:27.285673 18888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:27.286965 18861 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:56:27.287158 18861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "a96d5eb9d2bc435db87f28d81240ccd7"
format_stamp: "Formatted at 2026-08-08 14:56:27 on dist-test-slave-z8x9"
server_key: "229b2ae1579a9ee82a96337c12ba7ea5"
server_key_iv: "250e673a9e31bacf0a55e67a96a08125"
server_key_version: "encryptionkey@0"
I20260808 14:56:27.287364 18861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:27.303484 18861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:27.307951 18861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:27.308250 18861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:27.327090 18968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:36143 every 8 connection(s)
I20260808 14:56:27.327061 18861 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:36143
I20260808 14:56:27.328568 18861 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:27.332340 18969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:27.337754 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 18861
I20260808 14:56:27.338001 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:27.338629 12582 external_mini_cluster.cc:1428] Setting key 08b100cb7db0b4c200bc19563890548f
I20260808 14:56:27.343155 18969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7: Bootstrap starting.
I20260808 14:56:27.346860 18969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:27.347980 18969 log.cc:824] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:27.350951 18969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7: No bootstrap required, opened a new log
Aug 08 14:56:27 dist-test-slave-z8x9 krb5kdc[18835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200986, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:27.359648 18969 raft_consensus.cc:348] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a96d5eb9d2bc435db87f28d81240ccd7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36143 } }
I20260808 14:56:27.360028 18969 raft_consensus.cc:374] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:27.360165 18969 raft_consensus.cc:729] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96d5eb9d2bc435db87f28d81240ccd7, State: Initialized, Role: FOLLOWER
I20260808 14:56:27.360890 18969 consensus_queue.cc:260] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a96d5eb9d2bc435db87f28d81240ccd7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36143 } }
I20260808 14:56:27.361238 18969 raft_consensus.cc:388] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:27.361418 18969 raft_consensus.cc:482] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:27.361613 18969 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:27.362879 18972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:27.340770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33146 (local address 127.12.73.190:36143)
0808 14:56:27.341675 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:27.341686 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:27.341725 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:56:27.343484 (+ 1759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:27.343506 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:27.343849 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:27.344152 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:27.346180 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:27.347596 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:27.349284 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:27.349927 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:27.350052 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:27.354848 (+ 4796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:27.354856 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:27.354871 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:27.354908 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:27.358382 (+ 3474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:27.359144 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:27.359152 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:27.359159 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:27.359341 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:27.359751 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:27.359755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:27.359757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:27.360467 (+ 710us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:27.360777 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:27.361367 (+ 590us) server_negotiation.cc:299] Negotiation successful
0808 14:56:27.361848 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":454,"threads_started":1}
I20260808 14:56:27.364085 18969 raft_consensus.cc:504] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a96d5eb9d2bc435db87f28d81240ccd7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36143 } }
I20260808 14:56:27.364688 18969 leader_election.cc:302] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a96d5eb9d2bc435db87f28d81240ccd7; no voters:
I20260808 14:56:27.365430 18969 leader_election.cc:288] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:27.365543 18975 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:27.366706 18975 raft_consensus.cc:686] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [term 1 LEADER]: Becoming Leader. State: Replica: a96d5eb9d2bc435db87f28d81240ccd7, State: Running, Role: LEADER
I20260808 14:56:27.367218 18975 consensus_queue.cc:237] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a96d5eb9d2bc435db87f28d81240ccd7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36143 } }
I20260808 14:56:27.367533 18969 sys_catalog.cc:564] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:27.369789 18977 sys_catalog.cc:455] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a96d5eb9d2bc435db87f28d81240ccd7. Latest consensus state: current_term: 1 leader_uuid: "a96d5eb9d2bc435db87f28d81240ccd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a96d5eb9d2bc435db87f28d81240ccd7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36143 } } }
I20260808 14:56:27.370167 18977 sys_catalog.cc:458] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:27.370783 18976 sys_catalog.cc:455] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a96d5eb9d2bc435db87f28d81240ccd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a96d5eb9d2bc435db87f28d81240ccd7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36143 } } }
I20260808 14:56:27.371130 18976 sys_catalog.cc:458] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:27.384503 18982 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:27.390522 18982 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:27.399889 18982 catalog_manager.cc:1347] Generated new cluster ID: 038480d6b9be431d82ccff35521550a7
I20260808 14:56:27.400015 18982 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:27.422609 18982 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:27.424213 18982 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:27.440711 18982 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a96d5eb9d2bc435db87f28d81240ccd7: Generated new TSK 0
I20260808 14:56:27.441884 18982 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:56:27.510877 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36143
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:45333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:27.850512 19016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:27.850798 19016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:27.850904 19016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:27.858530 19016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:27.858636 19016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:27.858788 19016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:56:27.868840 19016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:27.870185 19016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:27.871482 19016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:27.884482 19023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:27.884505 19022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:27.884636 19025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:27.885957 19016 server_base.cc:1034] running on GCE node
I20260808 14:56:27.886508 19016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:27.887368 19016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:27.888528 19016 hybrid_clock.cc:648] HybridClock initialized: now 1786200987888497 us; error 26 us; skew 500 ppm
I20260808 14:56:27.888865 19016 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:27 dist-test-slave-z8x9 krb5kdc[18835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200987, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:27.892377 19016 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:56:27.893775 19016 webserver.cc:460] Webserver started at http://127.12.73.129:40697/ using document root <none> and password file <none>
I20260808 14:56:27.894423 19016 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:27.894527 19016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:27.894778 19016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:27.897639 19016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "a683b5dd130f4d2996c68bbef987e1e8"
format_stamp: "Formatted at 2026-08-08 14:56:27 on dist-test-slave-z8x9"
server_key: "8a73bbdd10d6c46f7571f343bdbffc71"
server_key_iv: "565ab18b4bd1ff2ba4c2ab2ec63bfe1e"
server_key_version: "encryptionkey@0"
I20260808 14:56:27.898384 19016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "a683b5dd130f4d2996c68bbef987e1e8"
format_stamp: "Formatted at 2026-08-08 14:56:27 on dist-test-slave-z8x9"
server_key: "8a73bbdd10d6c46f7571f343bdbffc71"
server_key_iv: "565ab18b4bd1ff2ba4c2ab2ec63bfe1e"
server_key_version: "encryptionkey@0"
I20260808 14:56:27.903272 19016 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:56:27.906567 19033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:27.907791 19016 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260808 14:56:27.907974 19016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "a683b5dd130f4d2996c68bbef987e1e8"
format_stamp: "Formatted at 2026-08-08 14:56:27 on dist-test-slave-z8x9"
server_key: "8a73bbdd10d6c46f7571f343bdbffc71"
server_key_iv: "565ab18b4bd1ff2ba4c2ab2ec63bfe1e"
server_key_version: "encryptionkey@0"
I20260808 14:56:27.908213 19016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:27.930114 19016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:27.934299 19016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:27.934610 19016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:27.935606 19016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:27.936947 19016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:27.937021 19016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:27.937191 19016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:27.937263 19016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 14:56:27.969847 19016 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:33191
I20260808 14:56:27.969884 19219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:33191 every 8 connection(s)
I20260808 14:56:27.971145 19016 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:56:27.976801 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 19016
I20260808 14:56:27.977027 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:56:27.977855 12582 external_mini_cluster.cc:1428] Setting key a05991f73afcee455f5bd9699795d65b
Aug 08 14:56:27 dist-test-slave-z8x9 krb5kdc[18835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200987, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:27.992645 19222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:27.973803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:40203 (local address 127.12.73.190:36143)
0808 14:56:27.974226 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:27.974231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:27.975287 (+ 1056us) server_negotiation.cc:407] Connection header received
0808 14:56:27.977199 (+ 1912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:27.977207 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:27.977319 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:27.977456 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:27.978953 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:27.979863 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:27.981461 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:27.982204 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:27.982351 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:27.986645 (+ 4294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:27.986651 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:27.986654 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:27.986686 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:27.989403 (+ 2717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:27.990100 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:27.990109 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:27.990113 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:27.990277 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:27.990731 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:27.990745 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:27.990751 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:27.991013 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:27.991179 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:27.991991 (+ 812us) server_negotiation.cc:299] Negotiation successful
0808 14:56:27.992255 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":206,"threads_started":1}
I20260808 14:56:27.993639 19223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:27.974396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36143 (local address 127.12.73.129:40203)
0808 14:56:27.975093 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:27.975137 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:27.976842 (+ 1705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:27.977636 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:27.977644 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:27.978221 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:27.978767 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:27.978783 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:27.980044 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:27.980048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:27.981308 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:27.981326 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:27.982418 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:27.982422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:27.982607 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:27.983289 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:27.983311 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:27.986428 (+ 3117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:27.989528 (+ 3100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:27.989535 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:27.989546 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:27.989970 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:27.990403 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:27.990408 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:27.990418 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:27.990598 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:27.991144 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:27.991151 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:27.991566 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 14:56:27.991883 (+ 317us) client_negotiation.cc:240] Negotiation successful
0808 14:56:27.992401 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":281,"threads_started":1}
I20260808 14:56:27.995405 19220 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36143
I20260808 14:56:27.995723 19220 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:27.996421 19220 heartbeater.cc:511] Master 127.12.73.190:36143 requested a full tablet report, sending...
I20260808 14:56:27.998874 18915 ts_manager.cc:194] Registered new tserver with Master: a683b5dd130f4d2996c68bbef987e1e8 (127.12.73.129:33191)
I20260808 14:56:28.001050 18915 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:40203
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:56:28.030540 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36143
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:45333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:28.359535 19227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:28.359822 19227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:28.359915 19227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:28.367179 19227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:28.367298 19227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:28.367410 19227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:56:28.376840 19227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:28.378089 19227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:28.379356 19227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:28.392232 19234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:28.392185 19237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:28.392280 19235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:28.393505 19227 server_base.cc:1034] running on GCE node
I20260808 14:56:28.394109 19227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:28.394980 19227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:28.396204 19227 hybrid_clock.cc:648] HybridClock initialized: now 1786200988396118 us; error 56 us; skew 500 ppm
I20260808 14:56:28.396513 19227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:28 dist-test-slave-z8x9 krb5kdc[18835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200988, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:28.399880 19227 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:56:28.401455 19227 webserver.cc:460] Webserver started at http://127.12.73.130:42783/ using document root <none> and password file <none>
I20260808 14:56:28.402129 19227 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:28.402272 19227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:28.402593 19227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:28.405637 19227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "7d3d5c083c0949e38c3d6549f3ccb304"
format_stamp: "Formatted at 2026-08-08 14:56:28 on dist-test-slave-z8x9"
server_key: "fded5b85732a47a76ed04dab86223fd7"
server_key_iv: "3be2482cc389c2edacabf467a78e2c7f"
server_key_version: "encryptionkey@0"
I20260808 14:56:28.406538 19227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "7d3d5c083c0949e38c3d6549f3ccb304"
format_stamp: "Formatted at 2026-08-08 14:56:28 on dist-test-slave-z8x9"
server_key: "fded5b85732a47a76ed04dab86223fd7"
server_key_iv: "3be2482cc389c2edacabf467a78e2c7f"
server_key_version: "encryptionkey@0"
I20260808 14:56:28.411660 19227 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:56:28.415253 19247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:28.416539 19227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:56:28.416708 19227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "7d3d5c083c0949e38c3d6549f3ccb304"
format_stamp: "Formatted at 2026-08-08 14:56:28 on dist-test-slave-z8x9"
server_key: "fded5b85732a47a76ed04dab86223fd7"
server_key_iv: "3be2482cc389c2edacabf467a78e2c7f"
server_key_version: "encryptionkey@0"
I20260808 14:56:28.416899 19227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:28.440006 19227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:28.444602 19227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:28.444922 19227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:28.446054 19227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:28.447431 19227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:28.447508 19227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:28.447657 19227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:28.447718 19227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:28.482167 19227 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:40853
I20260808 14:56:28.482276 19432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:40853 every 8 connection(s)
I20260808 14:56:28.483484 19227 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:56:28.492019 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 19227
I20260808 14:56:28.492234 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:56:28.492794 12582 external_mini_cluster.cc:1428] Setting key d7c771af59006d8d44fa6781ac0815fd
Aug 08 14:56:28 dist-test-slave-z8x9 krb5kdc[18835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200988, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:28.504283 19222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:28.486007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:40661 (local address 127.12.73.190:36143)
0808 14:56:28.486204 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:28.486208 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:28.487345 (+ 1137us) server_negotiation.cc:407] Connection header received
0808 14:56:28.489108 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:28.489113 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:28.489237 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:28.489327 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:28.490964 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:28.491760 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:28.493971 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:28.494526 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:28.494673 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:28.498513 (+ 3840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:28.498518 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:28.498522 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:28.498553 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:28.501276 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:28.501983 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:28.501990 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:28.501994 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:28.502129 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:28.502553 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:28.502559 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:28.502563 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:28.502841 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:28.503002 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:28.503693 (+ 691us) server_negotiation.cc:299] Negotiation successful
0808 14:56:28.503924 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":75}
I20260808 14:56:28.505421 19435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:28.486501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36143 (local address 127.12.73.130:40661)
0808 14:56:28.487191 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:28.487229 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:28.488845 (+ 1616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:28.489570 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:28.489578 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:28.490100 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:28.490684 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:28.490703 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:28.491944 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:28.491950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:28.493831 (+ 1881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:28.493848 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:28.494782 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:28.494792 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:28.495076 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:28.495791 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:28.495813 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:28.498285 (+ 2472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:28.501413 (+ 3128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:28.501422 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:28.501436 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:28.501864 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:28.502244 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:28.502248 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:28.502252 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:28.502438 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:28.502983 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:28.502990 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:28.503324 (+ 334us) client_negotiation.cc:769] Sending connection context
0808 14:56:28.503590 (+ 266us) client_negotiation.cc:240] Negotiation successful
0808 14:56:28.504096 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":268,"threads_started":1}
I20260808 14:56:28.506938 19433 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36143
I20260808 14:56:28.507261 19433 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:28.507970 19433 heartbeater.cc:511] Master 127.12.73.190:36143 requested a full tablet report, sending...
I20260808 14:56:28.509503 18915 ts_manager.cc:194] Registered new tserver with Master: 7d3d5c083c0949e38c3d6549f3ccb304 (127.12.73.130:40853)
I20260808 14:56:28.510309 18915 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:40661
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:56:28.542649 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36143
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:45333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:28.875365 19444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:28.875669 19444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:28.875844 19444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:28.883033 19444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:28.883203 19444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:28.883379 19444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:56:28.893244 19444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:28.894500 19444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:28.895809 19444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:28.909420 19455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:28.909361 19458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:28.909453 19456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:28.910362 19444 server_base.cc:1034] running on GCE node
I20260808 14:56:28.911072 19444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:28.912075 19444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:28.913286 19444 hybrid_clock.cc:648] HybridClock initialized: now 1786200988913226 us; error 33 us; skew 500 ppm
I20260808 14:56:28.913605 19444 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:28 dist-test-slave-z8x9 krb5kdc[18835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200988, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:28.916911 19444 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:56:28.918558 19444 webserver.cc:460] Webserver started at http://127.12.73.131:40259/ using document root <none> and password file <none>
I20260808 14:56:28.919278 19444 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:28.919428 19444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:28.919744 19444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:28.922713 19444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "6809f430a7a6443081c7dda0b50da654"
format_stamp: "Formatted at 2026-08-08 14:56:28 on dist-test-slave-z8x9"
server_key: "ee23dfb7fb873ecaba7137ba21c10d57"
server_key_iv: "4c310de5fa64fc481c2ec83bd32284b3"
server_key_version: "encryptionkey@0"
I20260808 14:56:28.923499 19444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "6809f430a7a6443081c7dda0b50da654"
format_stamp: "Formatted at 2026-08-08 14:56:28 on dist-test-slave-z8x9"
server_key: "ee23dfb7fb873ecaba7137ba21c10d57"
server_key_iv: "4c310de5fa64fc481c2ec83bd32284b3"
server_key_version: "encryptionkey@0"
I20260808 14:56:28.928627 19444 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:56:28.932106 19470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:28.933444 19444 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:28.933624 19444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "6809f430a7a6443081c7dda0b50da654"
format_stamp: "Formatted at 2026-08-08 14:56:28 on dist-test-slave-z8x9"
server_key: "ee23dfb7fb873ecaba7137ba21c10d57"
server_key_iv: "4c310de5fa64fc481c2ec83bd32284b3"
server_key_version: "encryptionkey@0"
I20260808 14:56:28.933827 19444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:28.953287 19444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:28.957631 19444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:28.957926 19444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:28.958902 19444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:28.960232 19444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:28.960346 19444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:28.960500 19444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:28.960572 19444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:28.995378 19444 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:43899
I20260808 14:56:28.995438 19656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:43899 every 8 connection(s)
I20260808 14:56:28.996734 19444 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:56:29.002982 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 19444
I20260808 14:56:29.003204 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:56:29.003643 12582 external_mini_cluster.cc:1428] Setting key c409f59dd1ad14e0905b1d900beb277d
I20260808 14:56:29.004644 19220 heartbeater.cc:503] Master 127.12.73.190:36143 was elected leader, sending a full tablet report...
Aug 08 14:56:29 dist-test-slave-z8x9 krb5kdc[18835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200988, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:29.017573 19222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:28.999330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:43081 (local address 127.12.73.190:36143)
0808 14:56:28.999509 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:28.999513 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:29.000675 (+ 1162us) server_negotiation.cc:407] Connection header received
0808 14:56:29.002517 (+ 1842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:29.002526 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:29.002640 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:29.002776 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:29.004497 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.005717 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.007719 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.008129 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.008263 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:29.011795 (+ 3532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:29.011808 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:29.011811 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:29.011844 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:29.014461 (+ 2617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:29.015185 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:29.015191 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:29.015194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:29.015331 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:29.015759 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:29.015764 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:29.015768 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:29.016118 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:29.016269 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:29.016921 (+ 652us) server_negotiation.cc:299] Negotiation successful
0808 14:56:29.017154 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:56:29.018654 19661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:28.999819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36143 (local address 127.12.73.131:43081)
0808 14:56:29.000509 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:29.000552 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:29.002243 (+ 1691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:29.002984 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:29.002991 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:29.003602 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:29.004306 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:29.004335 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.005879 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.005887 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:29.007561 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:29.007575 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.008359 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.008369 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:29.008601 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:29.009337 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:29.009366 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:29.011573 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:29.014615 (+ 3042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:29.014624 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:29.014638 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:29.015058 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:29.015454 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:29.015459 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:29.015463 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:29.015645 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:29.016254 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:29.016261 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:29.016578 (+ 317us) client_negotiation.cc:769] Sending connection context
0808 14:56:29.016846 (+ 268us) client_negotiation.cc:240] Negotiation successful
0808 14:56:29.017386 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":269,"threads_started":1}
I20260808 14:56:29.019878 19657 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36143
I20260808 14:56:29.020171 19657 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:29.020942 19657 heartbeater.cc:511] Master 127.12.73.190:36143 requested a full tablet report, sending...
I20260808 14:56:29.022377 18914 ts_manager.cc:194] Registered new tserver with Master: 6809f430a7a6443081c7dda0b50da654 (127.12.73.131:43899)
I20260808 14:56:29.023212 18914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:43081
I20260808 14:56:29.031102 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:56:29 dist-test-slave-z8x9 krb5kdc[18835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:56:29 dist-test-slave-z8x9 krb5kdc[18835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:56:29.086756 19668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:29.069994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45480 (local address 127.12.73.129:33191)
0808 14:56:29.071690 (+ 1696us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:29.071697 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:29.071724 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:56:29.071783 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:29.071789 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:29.072014 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:29.072188 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:29.073712 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.074705 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.076119 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.076692 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.076838 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:29.080960 (+ 4122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:29.080972 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:29.080986 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:29.081021 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:29.083934 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:29.084634 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:29.084641 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:29.084643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:29.084805 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:29.085262 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:29.085266 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:29.085268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:29.085602 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:29.085841 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:29.086249 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 14:56:29.086456 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1539,"thread_start_us":1403,"threads_started":1}
Aug 08 14:56:29 dist-test-slave-z8x9 krb5kdc[18835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:29.104888 19222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:29.091504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33162 (local address 127.12.73.190:36143)
0808 14:56:29.091716 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:29.091723 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:29.091886 (+ 163us) server_negotiation.cc:407] Connection header received
0808 14:56:29.092077 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:29.092088 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:29.092151 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:29.092253 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:29.093539 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.094295 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.095562 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.095999 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.096140 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:29.099852 (+ 3712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:29.099858 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:29.099861 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:29.099893 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:29.102537 (+ 2644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:29.103258 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:29.103262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:29.103264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:29.103388 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:29.103772 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:29.103776 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:29.103778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:29.104071 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:29.104257 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:29.104484 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 14:56:29.104639 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260808 14:56:29.105540 18914 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33162
I20260808 14:56:29.106506 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 19016
I20260808 14:56:29.119963 19668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:29.107582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45484 (local address 127.12.73.129:33191)
0808 14:56:29.107807 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:29.107815 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:29.107926 (+ 111us) server_negotiation.cc:407] Connection header received
0808 14:56:29.108149 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:29.108154 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:29.108251 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:29.108367 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:29.109804 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.110575 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.111998 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.112464 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.112612 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:29.114997 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:29.115002 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:29.115006 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:29.115039 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:29.117854 (+ 2815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:29.118436 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:29.118441 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:29.118443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:29.118566 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:29.118934 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:29.118938 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:29.118940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:29.119173 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:29.119357 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:29.119576 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 14:56:29.119744 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 14:56:29.120653 19210 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:29.203627 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 19016
I20260808 14:56:29.227437 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 19227
Aug 08 14:56:29 dist-test-slave-z8x9 krb5kdc[18835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:56:29.243691 19686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:29.228334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33188 (local address 127.12.73.130:40853)
0808 14:56:29.228889 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:29.228896 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:29.228923 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:56:29.228993 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:29.228999 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:29.229292 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:29.229432 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:29.230556 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.231572 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.232820 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.233484 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.233576 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:29.237858 (+ 4282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:29.237869 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:29.237882 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:29.237920 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:29.240763 (+ 2843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:29.241511 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:29.241531 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:29.241533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:29.241661 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:29.242032 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:29.242038 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:29.242041 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:29.242425 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:29.242759 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:29.243076 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 14:56:29.243357 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":298,"threads_started":1}
I20260808 14:56:29.244921 19426 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:29.327913 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 19227
I20260808 14:56:29.354112 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 19444
Aug 08 14:56:29 dist-test-slave-z8x9 krb5kdc[18835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:56:29.370486 19691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:29.355011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56832 (local address 127.12.73.131:43899)
0808 14:56:29.355693 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:29.355700 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:29.355730 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:56:29.355792 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:29.355799 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:29.356018 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:29.356154 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:29.357538 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.358587 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.359774 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:29.360352 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:29.360449 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:29.364681 (+ 4232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:29.364694 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:29.364707 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:29.364739 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:29.367782 (+ 3043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:29.368442 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:29.368448 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:29.368450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:29.368581 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:29.368928 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:29.368931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:29.368933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:29.369394 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:29.369637 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:29.369959 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 14:56:29.370201 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":338,"threads_started":1}
I20260808 14:56:29.371739 19648 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:29.454525 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 19444
I20260808 14:56:29.478587 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 18861
I20260808 14:56:29.479737 18963 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:29.586151 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 18861
2026-08-08T14:56:29Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4230 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:56:29 dist-test-slave-z8x9 krb5kdc[19699](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:56:29 dist-test-slave-z8x9 krb5kdc[19699](info): set up 2 sockets
Aug 08 14:56:29 dist-test-slave-z8x9 krb5kdc[19699](info): commencing operation
krb5kdc: starting...
W20260808 14:56:30.946142 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.001s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:56:31 dist-test-slave-z8x9 krb5kdc[19699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:56:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:56:31.180603 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34681
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:33287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:34681
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:31.519666 19721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:31.519953 19721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:31.520049 19721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:31.527249 19721 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:31.527354 19721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:31.527410 19721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:31.527487 19721 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:31.527557 19721 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:31.537242 19721 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:33287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:34681
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:31.538558 19721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:31.539865 19721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:31.551685 19731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:31.551607 19732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:31.551638 19735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:31.552510 19721 server_base.cc:1034] running on GCE node
I20260808 14:56:31.553346 19721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:31.554733 19721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:31.555943 19721 hybrid_clock.cc:648] HybridClock initialized: now 1786200991555901 us; error 32 us; skew 500 ppm
I20260808 14:56:31.556309 19721 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:31 dist-test-slave-z8x9 krb5kdc[19699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200991, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:31.559531 19721 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:56:31.560719 19721 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:31.560835 19721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:31.561228 19721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:31.564198 19721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "d442d31b19e14da1a3f75aa5499358ad"
format_stamp: "Formatted at 2026-08-08 14:56:31 on dist-test-slave-z8x9"
server_key: "795cd3a2712b637bc9ee34bf8dd0a1f9"
server_key_iv: "e3d39249a847f5d8bd5cb656d281e9fe"
server_key_version: "encryptionkey@0"
I20260808 14:56:31.564993 19721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "d442d31b19e14da1a3f75aa5499358ad"
format_stamp: "Formatted at 2026-08-08 14:56:31 on dist-test-slave-z8x9"
server_key: "795cd3a2712b637bc9ee34bf8dd0a1f9"
server_key_iv: "e3d39249a847f5d8bd5cb656d281e9fe"
server_key_version: "encryptionkey@0"
I20260808 14:56:31.569973 19721 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 14:56:31.573397 19745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:31.574609 19721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:56:31.574805 19721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "d442d31b19e14da1a3f75aa5499358ad"
format_stamp: "Formatted at 2026-08-08 14:56:31 on dist-test-slave-z8x9"
server_key: "795cd3a2712b637bc9ee34bf8dd0a1f9"
server_key_iv: "e3d39249a847f5d8bd5cb656d281e9fe"
server_key_version: "encryptionkey@0"
I20260808 14:56:31.575035 19721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:31.589545 19721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:31.593786 19721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:31.594060 19721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:31.612358 19721 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:34681
I20260808 14:56:31.612380 19830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:34681 every 8 connection(s)
I20260808 14:56:31.613312 19721 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:31.616803 19831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:31.623811 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 19721
I20260808 14:56:31.624060 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:31.624922 12582 external_mini_cluster.cc:1428] Setting key 5376f9885b014951e3c41e95a7fa8bd3
I20260808 14:56:31.627928 19831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad: Bootstrap starting.
I20260808 14:56:31.631271 19831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:31.632579 19831 log.cc:824] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:31.635640 19831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad: No bootstrap required, opened a new log
Aug 08 14:56:31 dist-test-slave-z8x9 krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:31.644299 19831 raft_consensus.cc:348] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d442d31b19e14da1a3f75aa5499358ad" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34681 } }
I20260808 14:56:31.644652 19831 raft_consensus.cc:374] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:31.644750 19831 raft_consensus.cc:729] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d442d31b19e14da1a3f75aa5499358ad, State: Initialized, Role: FOLLOWER
I20260808 14:56:31.645432 19831 consensus_queue.cc:260] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d442d31b19e14da1a3f75aa5499358ad" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34681 } }
I20260808 14:56:31.645712 19831 raft_consensus.cc:388] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:31.645846 19831 raft_consensus.cc:482] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:31.646035 19831 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:31.648499 19831 raft_consensus.cc:504] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d442d31b19e14da1a3f75aa5499358ad" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34681 } }
I20260808 14:56:31.648870 19837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:31.627045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53188 (local address 127.12.73.190:34681)
0808 14:56:31.627849 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:31.627861 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:31.627901 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:56:31.629724 (+ 1823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:31.629749 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:31.630106 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:31.630420 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:31.632362 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:31.633875 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:31.635623 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:31.636318 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:31.636448 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:31.641153 (+ 4705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:31.641160 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:31.641233 (+ 73us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:31.641285 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:31.644367 (+ 3082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:31.645215 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:31.645223 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:31.645231 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:31.645461 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:31.645892 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:31.645899 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:31.645907 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:31.646564 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:31.646926 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:31.647423 (+ 497us) server_negotiation.cc:299] Negotiation successful
0808 14:56:31.647833 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":368,"threads_started":1}
I20260808 14:56:31.649010 19831 leader_election.cc:302] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d442d31b19e14da1a3f75aa5499358ad; no voters:
I20260808 14:56:31.649758 19831 leader_election.cc:288] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:31.649871 19841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:31.652153 19831 sys_catalog.cc:564] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:31.652186 19841 raft_consensus.cc:686] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [term 1 LEADER]: Becoming Leader. State: Replica: d442d31b19e14da1a3f75aa5499358ad, State: Running, Role: LEADER
I20260808 14:56:31.652738 19841 consensus_queue.cc:237] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d442d31b19e14da1a3f75aa5499358ad" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34681 } }
I20260808 14:56:31.655654 19847 sys_catalog.cc:455] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader d442d31b19e14da1a3f75aa5499358ad. Latest consensus state: current_term: 1 leader_uuid: "d442d31b19e14da1a3f75aa5499358ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d442d31b19e14da1a3f75aa5499358ad" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34681 } } }
I20260808 14:56:31.656108 19847 sys_catalog.cc:458] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:31.656672 19842 sys_catalog.cc:455] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d442d31b19e14da1a3f75aa5499358ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d442d31b19e14da1a3f75aa5499358ad" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34681 } } }
I20260808 14:56:31.657027 19842 sys_catalog.cc:458] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:31.661948 19858 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:31.666922 19858 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:31.676986 19858 catalog_manager.cc:1347] Generated new cluster ID: 46cfce7f4ac841cc9691e108f6978507
I20260808 14:56:31.677116 19858 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:31.693444 19858 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:31.695307 19858 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:31.706751 19858 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad: Generated new TSK 0
I20260808 14:56:31.707775 19858 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:56:31.770793 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34681
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:33287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:32.103022 19876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:32.103345 19876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:32.103523 19876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:32.110692 19876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:32.110836 19876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:32.111009 19876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:56:32.120514 19876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:33287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34681
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:32.121833 19876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:32.123217 19876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:32.135936 19882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:32.135988 19883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:32.136027 19888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:32.137039 19876 server_base.cc:1034] running on GCE node
I20260808 14:56:32.137708 19876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:32.138604 19876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:32.139807 19876 hybrid_clock.cc:648] HybridClock initialized: now 1786200992139754 us; error 38 us; skew 500 ppm
I20260808 14:56:32.140165 19876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:32 dist-test-slave-z8x9 krb5kdc[19699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200992, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:32.143296 19876 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:56:32.144366 19876 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:32.144498 19876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:32.144801 19876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:32.147866 19876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "4c701746ee2946c0951e4140d93ab2eb"
format_stamp: "Formatted at 2026-08-08 14:56:32 on dist-test-slave-z8x9"
server_key: "9edcbde64e9fe475bdc2426e42965f11"
server_key_iv: "fa9f2b2bd869e4f4f1c267545e27cf2f"
server_key_version: "encryptionkey@0"
I20260808 14:56:32.148660 19876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "4c701746ee2946c0951e4140d93ab2eb"
format_stamp: "Formatted at 2026-08-08 14:56:32 on dist-test-slave-z8x9"
server_key: "9edcbde64e9fe475bdc2426e42965f11"
server_key_iv: "fa9f2b2bd869e4f4f1c267545e27cf2f"
server_key_version: "encryptionkey@0"
I20260808 14:56:32.153761 19876 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260808 14:56:32.157035 19896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:32.158398 19876 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:56:32.158568 19876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "4c701746ee2946c0951e4140d93ab2eb"
format_stamp: "Formatted at 2026-08-08 14:56:32 on dist-test-slave-z8x9"
server_key: "9edcbde64e9fe475bdc2426e42965f11"
server_key_iv: "fa9f2b2bd869e4f4f1c267545e27cf2f"
server_key_version: "encryptionkey@0"
I20260808 14:56:32.158795 19876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:32.174417 19876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:32.178217 19876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:32.178591 19876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:32.179613 19876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:32.180987 19876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:32.181113 19876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:32.181265 19876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:32.181366 19876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:32.214987 19876 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:34079
I20260808 14:56:32.215041 20079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:34079 every 8 connection(s)
I20260808 14:56:32.215866 19876 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:56:32.223587 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 19876
I20260808 14:56:32.223835 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:56:32.224505 12582 external_mini_cluster.cc:1428] Setting key b4f697cc64b5ce5f97e8684468bc753b
Aug 08 14:56:32 dist-test-slave-z8x9 krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200992, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:32.236552 20086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:32.218390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:46635 (local address 127.12.73.190:34681)
0808 14:56:32.218852 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:32.218857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:32.219855 (+ 998us) server_negotiation.cc:407] Connection header received
0808 14:56:32.221802 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:32.221810 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:32.221907 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:32.222031 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:32.223644 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:32.224561 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:32.226442 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:32.226859 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:32.227011 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:32.230680 (+ 3669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:32.230685 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:32.230688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:32.230720 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:32.233374 (+ 2654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:32.234138 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:32.234142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:32.234145 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:32.234302 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:32.234764 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:32.234768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:32.234770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:32.235031 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:32.235207 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:32.235928 (+ 721us) server_negotiation.cc:299] Negotiation successful
0808 14:56:32.236158 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":261,"threads_started":1}
I20260808 14:56:32.237576 20087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:32.218849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34681 (local address 127.12.73.129:46635)
0808 14:56:32.219651 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:32.219700 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:32.221519 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:32.222259 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:32.222267 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:32.222811 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:32.223468 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:32.223490 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:32.224767 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:32.224774 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:32.226266 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:32.226280 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:32.227101 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:32.227112 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:32.227348 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:32.228086 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:32.228109 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:32.230442 (+ 2333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:32.233520 (+ 3078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:32.233529 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:32.233545 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:32.233998 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:32.234422 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:32.234426 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:32.234430 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:32.234625 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:32.235170 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:32.235178 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:32.235531 (+ 353us) client_negotiation.cc:769] Sending connection context
0808 14:56:32.235809 (+ 278us) client_negotiation.cc:240] Negotiation successful
0808 14:56:32.236365 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":341,"threads_started":1}
I20260808 14:56:32.239265 20082 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34681
I20260808 14:56:32.239599 20082 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:32.240276 20082 heartbeater.cc:511] Master 127.12.73.190:34681 requested a full tablet report, sending...
I20260808 14:56:32.242347 19771 ts_manager.cc:194] Registered new tserver with Master: 4c701746ee2946c0951e4140d93ab2eb (127.12.73.129:34079)
I20260808 14:56:32.243762 19771 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:46635
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:56:32.276729 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34681
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:33287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:32.612115 20091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:32.612461 20091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:32.612644 20091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:32.620052 20091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:32.620209 20091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:32.620386 20091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:56:32.630276 20091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:33287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34681
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:32.631527 20091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:32.632767 20091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:32.645077 20097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:32.645164 20106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:32.645138 20098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:32.646194 20091 server_base.cc:1034] running on GCE node
I20260808 14:56:32.646814 20091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:32.647744 20091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:32.648968 20091 hybrid_clock.cc:648] HybridClock initialized: now 1786200992648914 us; error 50 us; skew 500 ppm
I20260808 14:56:32.649336 20091 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:32 dist-test-slave-z8x9 krb5kdc[19699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200992, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:32.655570 20091 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:56:32.656823 20091 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:32.656915 20091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:32.657347 20091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:32.660600 20091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "0b903fbb81334d6482e08f0293360088"
format_stamp: "Formatted at 2026-08-08 14:56:32 on dist-test-slave-z8x9"
server_key: "7a77baafa918ab216111ec6d25adf186"
server_key_iv: "e2df88eaacb67f7173474fadbf9d4acd"
server_key_version: "encryptionkey@0"
I20260808 14:56:32.661970 20091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "0b903fbb81334d6482e08f0293360088"
format_stamp: "Formatted at 2026-08-08 14:56:32 on dist-test-slave-z8x9"
server_key: "7a77baafa918ab216111ec6d25adf186"
server_key_iv: "e2df88eaacb67f7173474fadbf9d4acd"
server_key_version: "encryptionkey@0"
I20260808 14:56:32.668366 20091 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 14:56:32.672116 20113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:32.673517 20091 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:32.673688 20091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "0b903fbb81334d6482e08f0293360088"
format_stamp: "Formatted at 2026-08-08 14:56:32 on dist-test-slave-z8x9"
server_key: "7a77baafa918ab216111ec6d25adf186"
server_key_iv: "e2df88eaacb67f7173474fadbf9d4acd"
server_key_version: "encryptionkey@0"
I20260808 14:56:32.673934 20091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:32.687114 20091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:32.690987 20091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:32.691269 20091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:32.692179 20091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:32.693560 20091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:32.693686 20091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:32.693823 20091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:32.693913 20091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:32.728369 20091 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:42263
I20260808 14:56:32.728457 20315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:42263 every 8 connection(s)
I20260808 14:56:32.729255 20091 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:56:32.730259 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 20091
I20260808 14:56:32.730487 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:56:32.731081 12582 external_mini_cluster.cc:1428] Setting key 505d90858332810b4b3bc6470f87dbac
Aug 08 14:56:32 dist-test-slave-z8x9 krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200992, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:32.754781 20086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:32.732066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:33839 (local address 127.12.73.190:34681)
0808 14:56:32.732268 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:32.732280 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:32.733594 (+ 1314us) server_negotiation.cc:407] Connection header received
0808 14:56:32.736424 (+ 2830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:32.736428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:32.736495 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:32.736578 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:32.738747 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:32.739763 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:32.742441 (+ 2678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:32.742929 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:32.743027 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:32.747093 (+ 4066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:32.747102 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:32.747110 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:32.747155 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:32.751127 (+ 3972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:32.751943 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:32.751952 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:32.751958 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:32.752149 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:32.752584 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:32.752592 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:32.752598 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:32.753034 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:32.753214 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:32.754050 (+ 836us) server_negotiation.cc:299] Negotiation successful
0808 14:56:32.754304 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:56:32.755445 20319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:32.732544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34681 (local address 127.12.73.130:33839)
0808 14:56:32.733411 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:32.733462 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:32.736117 (+ 2655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:32.736846 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:32.736860 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:32.737723 (+ 863us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:32.738534 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:32.738562 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:32.739944 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:32.739952 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:32.742285 (+ 2333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:32.742304 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:32.743235 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:32.743245 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:32.743572 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:32.744361 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:32.744384 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:32.746829 (+ 2445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:32.751295 (+ 4466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:32.751302 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:32.751314 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:32.751775 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:32.752271 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:32.752274 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:32.752276 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:32.752459 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:32.753231 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:32.753237 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:32.753563 (+ 326us) client_negotiation.cc:769] Sending connection context
0808 14:56:32.753893 (+ 330us) client_negotiation.cc:240] Negotiation successful
0808 14:56:32.754301 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":352,"threads_started":1}
I20260808 14:56:32.756912 20316 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34681
I20260808 14:56:32.757323 20316 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:32.757956 20316 heartbeater.cc:511] Master 127.12.73.190:34681 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
I20260808 14:56:32.759372 19771 ts_manager.cc:194] Registered new tserver with Master: 0b903fbb81334d6482e08f0293360088 (127.12.73.130:42263)
I20260808 14:56:32.760180 19771 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:33839
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:56:32.788450 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34681
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:33287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:33.122352 20326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:33.122625 20326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:33.122786 20326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:33.130036 20326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:33.130155 20326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:33.130370 20326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:56:33.139966 20326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:33287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34681
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:33.141223 20326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:33.142530 20326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:33.155810 20334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:33.155763 20336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:33.155843 20338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:33.156886 20326 server_base.cc:1034] running on GCE node
I20260808 14:56:33.157581 20326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:33.158500 20326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:33.159737 20326 hybrid_clock.cc:648] HybridClock initialized: now 1786200993159691 us; error 54 us; skew 500 ppm
I20260808 14:56:33.160064 20326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:33 dist-test-slave-z8x9 krb5kdc[19699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200993, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:33.163460 20326 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:56:33.164677 20326 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:33.164793 20326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:33.165148 20326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:33.168056 20326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "0d05b13b8e0c4c4997c569669112117e"
format_stamp: "Formatted at 2026-08-08 14:56:33 on dist-test-slave-z8x9"
server_key: "50b5d0e9b21f6a32510381b0d60c6fa6"
server_key_iv: "2cc7165a097a3d0ceb969ca56d09b9a7"
server_key_version: "encryptionkey@0"
I20260808 14:56:33.168893 20326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "0d05b13b8e0c4c4997c569669112117e"
format_stamp: "Formatted at 2026-08-08 14:56:33 on dist-test-slave-z8x9"
server_key: "50b5d0e9b21f6a32510381b0d60c6fa6"
server_key_iv: "2cc7165a097a3d0ceb969ca56d09b9a7"
server_key_version: "encryptionkey@0"
I20260808 14:56:33.174141 20326 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260808 14:56:33.178347 20349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:33.179842 20326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260808 14:56:33.179989 20326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "0d05b13b8e0c4c4997c569669112117e"
format_stamp: "Formatted at 2026-08-08 14:56:33 on dist-test-slave-z8x9"
server_key: "50b5d0e9b21f6a32510381b0d60c6fa6"
server_key_iv: "2cc7165a097a3d0ceb969ca56d09b9a7"
server_key_version: "encryptionkey@0"
I20260808 14:56:33.180181 20326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:33.214829 20326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:33.220274 20326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:33.220603 20326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:33.221807 20326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:33.223173 20326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:33.223263 20326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:33.223352 20326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:33.223409 20326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:33.246683 20082 heartbeater.cc:503] Master 127.12.73.190:34681 was elected leader, sending a full tablet report...
I20260808 14:56:33.258788 20326 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:40225
I20260808 14:56:33.258891 20531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:40225 every 8 connection(s)
I20260808 14:56:33.259640 20326 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:56:33.261283 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 20326
I20260808 14:56:33.261557 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:56:33.262167 12582 external_mini_cluster.cc:1428] Setting key 7a9ffac3983540187b29ab9afc26458c
Aug 08 14:56:33 dist-test-slave-z8x9 krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200993, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:33.280694 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.262510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:51093 (local address 127.12.73.190:34681)
0808 14:56:33.263058 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:33.263065 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:33.264153 (+ 1088us) server_negotiation.cc:407] Connection header received
0808 14:56:33.266110 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:33.266114 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:33.266201 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:33.266292 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:33.267738 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.268526 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.270145 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.270629 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.270734 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.274133 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:33.274138 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:33.274141 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:33.274175 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:33.277687 (+ 3512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:33.278522 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:33.278526 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:33.278528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:33.278683 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:33.279084 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:33.279091 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:33.279095 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:33.279438 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:33.279556 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:33.280248 (+ 692us) server_negotiation.cc:299] Negotiation successful
0808 14:56:33.280417 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":282,"threads_started":1}
I20260808 14:56:33.281683 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.263166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34681 (local address 127.12.73.131:51093)
0808 14:56:33.263999 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:33.264053 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:33.265853 (+ 1800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:33.266478 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:33.266485 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:33.267015 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:33.267547 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:33.267564 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.268668 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.268671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:33.270012 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:33.270025 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.270814 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.270818 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:33.271008 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.271657 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:33.271678 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:33.273933 (+ 2255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:33.277821 (+ 3888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:33.277827 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:33.277840 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:33.278411 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:33.278789 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:33.278792 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:33.278794 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:33.278964 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:33.279567 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:33.279573 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:33.279881 (+ 308us) client_negotiation.cc:769] Sending connection context
0808 14:56:33.280110 (+ 229us) client_negotiation.cc:240] Negotiation successful
0808 14:56:33.280486 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":383,"threads_started":1}
I20260808 14:56:33.283012 20532 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34681
I20260808 14:56:33.283366 20532 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:33.284092 20532 heartbeater.cc:511] Master 127.12.73.190:34681 requested a full tablet report, sending...
I20260808 14:56:33.285521 19771 ts_manager.cc:194] Registered new tserver with Master: 0d05b13b8e0c4c4997c569669112117e (127.12.73.131:40225)
I20260808 14:56:33.286305 19771 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:51093
I20260808 14:56:33.289911 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:56:33.306493 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.294526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32856 (local address 127.12.73.190:34681)
0808 14:56:33.294693 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:33.294697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:33.295242 (+ 545us) server_negotiation.cc:407] Connection header received
0808 14:56:33.295418 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:33.295422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:33.295483 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:33.295576 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:33.296965 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.297785 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.298999 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.299393 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.299482 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.301672 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:33.301677 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:33.301680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:33.301709 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:33.304010 (+ 2301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:33.304580 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:33.304584 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:33.304586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:33.304696 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:33.305025 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:33.305028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:33.305030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:33.305438 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:33.305621 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:33.305966 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 14:56:33.306137 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:56:33.310374 19771 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32856:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:56:33.317142 19771 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:33.338353 20564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.328972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:42263 (local address 127.0.0.1:40534)
0808 14:56:33.329749 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:33.329793 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:33.329996 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:33.330851 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:33.330861 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:33.330890 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:33.331184 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:33.331192 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.333108 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.333116 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:33.335631 (+ 2515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:33.335643 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.337550 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.337557 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:33.337748 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.337784 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 14:56:33.337943 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 14:56:33.338073 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":365,"threads_started":1}
I20260808 14:56:33.338989 20562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.328992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40534 (local address 127.12.73.130:42263)
0808 14:56:33.330182 (+ 1190us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:33.330190 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:33.330223 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:56:33.330329 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:33.330347 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:33.330623 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:33.331355 (+ 732us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:33.331544 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.332981 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.335818 (+ 2837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.337263 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.337394 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.337612 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:33.338631 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0808 14:56:33.338780 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1023,"thread_start_us":1381,"threads_started":1}
I20260808 14:56:33.342729 20566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.329506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:34079 (local address 127.0.0.1:50594)
0808 14:56:33.330663 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:33.330681 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:33.330794 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:33.334939 (+ 4145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:33.334945 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:33.334969 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:33.335444 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:33.335459 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.337368 (+ 1909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.337373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:33.339928 (+ 2555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:33.339944 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.341822 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.341829 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:33.342002 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.342043 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:56:33.342158 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 14:56:33.342297 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1039,"mutex_wait_us":24,"thread_start_us":5448,"threads_started":1}
I20260808 14:56:33.342713 20568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.330080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50594 (local address 127.12.73.129:34079)
0808 14:56:33.333623 (+ 3543us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:33.333631 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:33.333660 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:56:33.333755 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:33.333762 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:33.333979 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:33.334170 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:33.335647 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.337227 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.340111 (+ 2884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.341603 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.341784 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.342006 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:33.342215 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 14:56:33.342368 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3375,"thread_start_us":3176,"threads_started":1}
I20260808 14:56:33.342736 20208 tablet_service.cc:1467] Processing CreateTablet for tablet 9dd24f45e2cc4e008ec0499a20079747 (DEFAULT_TABLE table=test-table [id=a83d23242b1645ab9cd511d743eddd70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:33.343796 20565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.330155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:40225 (local address 127.0.0.1:42018)
0808 14:56:33.335256 (+ 5101us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:33.335270 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:33.335431 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:33.336359 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:33.336362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:33.336381 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:33.336646 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:33.336653 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.338657 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.338664 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:33.340915 (+ 2251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:33.340930 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.342998 (+ 2068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.343006 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:33.343169 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.343199 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 14:56:33.343300 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:56:33.343431 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4984,"mutex_wait_us":55,"thread_start_us":999,"threads_started":1}
I20260808 14:56:33.343888 20570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.330860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42018 (local address 127.12.73.131:40225)
0808 14:56:33.334849 (+ 3989us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:33.334857 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:33.335570 (+ 713us) server_negotiation.cc:407] Connection header received
0808 14:56:33.335673 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:33.335680 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:33.335899 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:33.336077 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:33.336839 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.338480 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.341094 (+ 2614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.342498 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.342620 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.342846 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:33.343358 (+ 512us) server_negotiation.cc:299] Negotiation successful
0808 14:56:33.343526 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3819,"thread_start_us":3680,"threads_started":1}
I20260808 14:56:33.344313 20208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dd24f45e2cc4e008ec0499a20079747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:33.346383 19977 tablet_service.cc:1467] Processing CreateTablet for tablet 9dd24f45e2cc4e008ec0499a20079747 (DEFAULT_TABLE table=test-table [id=a83d23242b1645ab9cd511d743eddd70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:33.347618 19977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dd24f45e2cc4e008ec0499a20079747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:33.347674 20435 tablet_service.cc:1467] Processing CreateTablet for tablet 9dd24f45e2cc4e008ec0499a20079747 (DEFAULT_TABLE table=test-table [id=a83d23242b1645ab9cd511d743eddd70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:33.348757 20435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dd24f45e2cc4e008ec0499a20079747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:33.360518 20572 tablet_bootstrap.cc:492] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb: Bootstrap starting.
I20260808 14:56:33.362709 20573 tablet_bootstrap.cc:492] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e: Bootstrap starting.
I20260808 14:56:33.364400 20572 tablet_bootstrap.cc:654] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:33.364773 20574 tablet_bootstrap.cc:492] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088: Bootstrap starting.
I20260808 14:56:33.365772 20572 log.cc:824] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:33.366525 20573 tablet_bootstrap.cc:654] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:33.367676 20573 log.cc:824] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:33.368073 20574 tablet_bootstrap.cc:654] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:33.369328 20574 log.cc:824] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:33.369940 20572 tablet_bootstrap.cc:492] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb: No bootstrap required, opened a new log
I20260808 14:56:33.370242 20572 ts_tablet_manager.cc:1397] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 14:56:33.370803 20573 tablet_bootstrap.cc:492] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e: No bootstrap required, opened a new log
I20260808 14:56:33.371065 20573 ts_tablet_manager.cc:1397] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 14:56:33.371830 20574 tablet_bootstrap.cc:492] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088: No bootstrap required, opened a new log
I20260808 14:56:33.372087 20574 ts_tablet_manager.cc:1397] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 14:56:33.379205 20574 raft_consensus.cc:348] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b903fbb81334d6482e08f0293360088" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42263 } } peers { permanent_uuid: "4c701746ee2946c0951e4140d93ab2eb" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34079 } } peers { permanent_uuid: "0d05b13b8e0c4c4997c569669112117e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 40225 } }
I20260808 14:56:33.379674 20574 raft_consensus.cc:374] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:33.379789 20574 raft_consensus.cc:729] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b903fbb81334d6482e08f0293360088, State: Initialized, Role: FOLLOWER
I20260808 14:56:33.380370 20574 consensus_queue.cc:260] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b903fbb81334d6482e08f0293360088" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42263 } } peers { permanent_uuid: "4c701746ee2946c0951e4140d93ab2eb" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34079 } } peers { permanent_uuid: "0d05b13b8e0c4c4997c569669112117e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 40225 } }
I20260808 14:56:33.381502 20316 heartbeater.cc:503] Master 127.12.73.190:34681 was elected leader, sending a full tablet report...
I20260808 14:56:33.381701 20572 raft_consensus.cc:348] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b903fbb81334d6482e08f0293360088" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42263 } } peers { permanent_uuid: "4c701746ee2946c0951e4140d93ab2eb" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34079 } } peers { permanent_uuid: "0d05b13b8e0c4c4997c569669112117e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 40225 } }
I20260808 14:56:33.381994 20574 ts_tablet_manager.cc:1428] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260808 14:56:33.382114 20572 raft_consensus.cc:374] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:33.382232 20572 raft_consensus.cc:729] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c701746ee2946c0951e4140d93ab2eb, State: Initialized, Role: FOLLOWER
I20260808 14:56:33.382551 20573 raft_consensus.cc:348] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b903fbb81334d6482e08f0293360088" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42263 } } peers { permanent_uuid: "4c701746ee2946c0951e4140d93ab2eb" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34079 } } peers { permanent_uuid: "0d05b13b8e0c4c4997c569669112117e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 40225 } }
I20260808 14:56:33.382959 20573 raft_consensus.cc:374] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:33.382818 20572 consensus_queue.cc:260] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b903fbb81334d6482e08f0293360088" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42263 } } peers { permanent_uuid: "4c701746ee2946c0951e4140d93ab2eb" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34079 } } peers { permanent_uuid: "0d05b13b8e0c4c4997c569669112117e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 40225 } }
I20260808 14:56:33.383107 20573 raft_consensus.cc:729] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d05b13b8e0c4c4997c569669112117e, State: Initialized, Role: FOLLOWER
I20260808 14:56:33.383769 20573 consensus_queue.cc:260] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b903fbb81334d6482e08f0293360088" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42263 } } peers { permanent_uuid: "4c701746ee2946c0951e4140d93ab2eb" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34079 } } peers { permanent_uuid: "0d05b13b8e0c4c4997c569669112117e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 40225 } }
I20260808 14:56:33.384707 20572 ts_tablet_manager.cc:1428] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260808 14:56:33.385696 20532 heartbeater.cc:503] Master 127.12.73.190:34681 was elected leader, sending a full tablet report...
I20260808 14:56:33.386219 20573 ts_tablet_manager.cc:1428] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e: Time spent starting tablet: real 0.015s user 0.010s sys 0.005s
I20260808 14:56:33.427168 20582 raft_consensus.cc:482] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:33.427510 20582 raft_consensus.cc:504] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b903fbb81334d6482e08f0293360088" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42263 } } peers { permanent_uuid: "4c701746ee2946c0951e4140d93ab2eb" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34079 } } peers { permanent_uuid: "0d05b13b8e0c4c4997c569669112117e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 40225 } }
I20260808 14:56:33.429144 20582 leader_election.cc:288] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b903fbb81334d6482e08f0293360088 (127.12.73.130:42263), 4c701746ee2946c0951e4140d93ab2eb (127.12.73.129:34079)
I20260808 14:56:33.435554 20562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.429664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:43609 (local address 127.12.73.130:42263)
0808 14:56:33.429858 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:33.429864 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:33.429883 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:56:33.430066 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:33.430075 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:33.430163 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:33.430271 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:33.430706 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.431704 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.433563 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.434642 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.434757 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.434807 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:33.435156 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 14:56:33.435263 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:56:33.435580 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.429438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:42263 (local address 127.12.73.131:43609)
0808 14:56:33.429714 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:33.429739 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:33.429866 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:33.430310 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:33.430314 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:33.430347 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:33.430547 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:33.430560 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.431844 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.431850 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:33.433412 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:33.433424 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.434786 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.434792 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:33.434987 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.435026 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:56:33.435127 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:56:33.435259 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":1}
I20260808 14:56:33.436275 20568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.429757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:45841 (local address 127.12.73.129:34079)
0808 14:56:33.429984 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:33.429993 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:33.430511 (+ 518us) server_negotiation.cc:407] Connection header received
0808 14:56:33.430617 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:33.430625 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:33.430712 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:33.430778 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:33.431357 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.432262 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.434275 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.435251 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.435399 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.435472 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:33.435887 (+ 415us) server_negotiation.cc:299] Negotiation successful
0808 14:56:33.436018 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:56:33.436313 20583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.429639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:34079 (local address 127.12.73.131:45841)
0808 14:56:33.430381 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:33.430402 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:33.430513 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:33.430835 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:33.430840 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:33.430865 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:33.431205 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:33.431217 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.432433 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.432437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:33.434106 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:33.434122 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.435457 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.435463 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:33.435649 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.435687 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:56:33.435856 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 14:56:33.435981 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":404,"threads_started":1}
I20260808 14:56:33.436589 20245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dd24f45e2cc4e008ec0499a20079747" candidate_uuid: "0d05b13b8e0c4c4997c569669112117e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b903fbb81334d6482e08f0293360088" is_pre_election: true
I20260808 14:56:33.437105 20245 raft_consensus.cc:2454] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d05b13b8e0c4c4997c569669112117e in term 0.
I20260808 14:56:33.437326 20011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dd24f45e2cc4e008ec0499a20079747" candidate_uuid: "0d05b13b8e0c4c4997c569669112117e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c701746ee2946c0951e4140d93ab2eb" is_pre_election: true
I20260808 14:56:33.437830 20360 leader_election.cc:302] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b903fbb81334d6482e08f0293360088, 0d05b13b8e0c4c4997c569669112117e; no voters:
I20260808 14:56:33.437841 20011 raft_consensus.cc:2454] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d05b13b8e0c4c4997c569669112117e in term 0.
I20260808 14:56:33.438270 20582 raft_consensus.cc:2781] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:33.438438 20582 raft_consensus.cc:482] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:33.438575 20582 raft_consensus.cc:3037] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:33.440748 20582 raft_consensus.cc:504] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b903fbb81334d6482e08f0293360088" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42263 } } peers { permanent_uuid: "4c701746ee2946c0951e4140d93ab2eb" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34079 } } peers { permanent_uuid: "0d05b13b8e0c4c4997c569669112117e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 40225 } }
I20260808 14:56:33.441409 20582 leader_election.cc:288] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [CANDIDATE]: Term 1 election: Requested vote from peers 0b903fbb81334d6482e08f0293360088 (127.12.73.130:42263), 4c701746ee2946c0951e4140d93ab2eb (127.12.73.129:34079)
I20260808 14:56:33.441828 20245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dd24f45e2cc4e008ec0499a20079747" candidate_uuid: "0d05b13b8e0c4c4997c569669112117e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b903fbb81334d6482e08f0293360088"
I20260808 14:56:33.441875 20011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9dd24f45e2cc4e008ec0499a20079747" candidate_uuid: "0d05b13b8e0c4c4997c569669112117e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c701746ee2946c0951e4140d93ab2eb"
I20260808 14:56:33.442021 20245 raft_consensus.cc:3037] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:33.442087 20011 raft_consensus.cc:3037] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:33.444252 20245 raft_consensus.cc:2454] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d05b13b8e0c4c4997c569669112117e in term 1.
I20260808 14:56:33.444301 20011 raft_consensus.cc:2454] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d05b13b8e0c4c4997c569669112117e in term 1.
I20260808 14:56:33.444617 20360 leader_election.cc:302] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b903fbb81334d6482e08f0293360088, 0d05b13b8e0c4c4997c569669112117e; no voters:
I20260808 14:56:33.445034 20582 raft_consensus.cc:2781] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:33.445533 20582 raft_consensus.cc:686] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 1 LEADER]: Becoming Leader. State: Replica: 0d05b13b8e0c4c4997c569669112117e, State: Running, Role: LEADER
I20260808 14:56:33.446030 20582 consensus_queue.cc:237] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b903fbb81334d6482e08f0293360088" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42263 } } peers { permanent_uuid: "4c701746ee2946c0951e4140d93ab2eb" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34079 } } peers { permanent_uuid: "0d05b13b8e0c4c4997c569669112117e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 40225 } }
I20260808 14:56:33.450896 19769 catalog_manager.cc:5495] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d05b13b8e0c4c4997c569669112117e (127.12.73.131). New cstate: current_term: 1 leader_uuid: "0d05b13b8e0c4c4997c569669112117e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b903fbb81334d6482e08f0293360088" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c701746ee2946c0951e4140d93ab2eb" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d05b13b8e0c4c4997c569669112117e" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 40225 } health_report { overall_health: HEALTHY } } }
W20260808 14:56:33.468151 20083 tablet.cc:2369] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:56:33.481295 20318 tablet.cc:2369] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:56:33.492795 20570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.487494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42032 (local address 127.12.73.131:40225)
0808 14:56:33.487706 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:33.487712 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:33.487732 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:56:33.487982 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:33.487986 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:33.488062 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:33.488212 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:33.488589 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.489364 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.490715 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.491132 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.491268 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.491760 (+ 492us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:33.492230 (+ 470us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:33.492393 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:33.492455 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 14:56:33.492534 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:56:33.500422 20245 raft_consensus.cc:1261] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088 [term 1 FOLLOWER]: Refusing update from remote peer 0d05b13b8e0c4c4997c569669112117e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:33.500422 20011 raft_consensus.cc:1261] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb [term 1 FOLLOWER]: Refusing update from remote peer 0d05b13b8e0c4c4997c569669112117e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:33.501398 20584 consensus_queue.cc:1035] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b903fbb81334d6482e08f0293360088" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:33.501720 20582 consensus_queue.cc:1035] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c701746ee2946c0951e4140d93ab2eb" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:56:33.511096 20533 tablet.cc:2369] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:56:33.529383 19769 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:33.529667 19769 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32856:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:33.533279 19769 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d442d31b19e14da1a3f75aa5499358ad: Sending DeleteTablet for 3 replicas of tablet 9dd24f45e2cc4e008ec0499a20079747
I20260808 14:56:33.534420 20208 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dd24f45e2cc4e008ec0499a20079747 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:33 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:40534
I20260808 14:56:33.534540 20435 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dd24f45e2cc4e008ec0499a20079747 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:33 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:42018
I20260808 14:56:33.534569 19977 tablet_service.cc:1514] Processing DeleteTablet for tablet 9dd24f45e2cc4e008ec0499a20079747 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:33 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:50594
I20260808 14:56:33.539219 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 19876
I20260808 14:56:33.546833 20601 tablet_replica.cc:330] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e: stopping tablet replica
I20260808 14:56:33.547109 20602 tablet_replica.cc:330] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb: stopping tablet replica
I20260808 14:56:33.547413 20601 raft_consensus.cc:2229] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:56:33.547699 20602 raft_consensus.cc:2229] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:33.548281 20602 raft_consensus.cc:2258] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:33.548306 20601 raft_consensus.cc:2258] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:33.550962 20602 ts_tablet_manager.cc:1905] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:33.554590 20601 ts_tablet_manager.cc:1905] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:33.558672 20602 ts_tablet_manager.cc:1918] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:33.559080 20602 log.cc:1196] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/9dd24f45e2cc4e008ec0499a20079747
I20260808 14:56:33.559778 20602 ts_tablet_manager.cc:1939] T 9dd24f45e2cc4e008ec0499a20079747 P 4c701746ee2946c0951e4140d93ab2eb: Deleting consensus metadata
I20260808 14:56:33.561885 19750 catalog_manager.cc:4841] TS 4c701746ee2946c0951e4140d93ab2eb (127.12.73.129:34079): tablet 9dd24f45e2cc4e008ec0499a20079747 (table test-table [id=a83d23242b1645ab9cd511d743eddd70]) successfully deleted
I20260808 14:56:33.562955 20600 tablet_replica.cc:330] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088: stopping tablet replica
I20260808 14:56:33.563519 20600 raft_consensus.cc:2229] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:33.564060 20600 raft_consensus.cc:2258] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 08 14:56:33 dist-test-slave-z8x9 krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:56:33.566220 20600 ts_tablet_manager.cc:1905] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:33.567148 20601 ts_tablet_manager.cc:1918] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:33.567320 20601 log.cc:1196] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/9dd24f45e2cc4e008ec0499a20079747
I20260808 14:56:33.567891 20601 ts_tablet_manager.cc:1939] T 9dd24f45e2cc4e008ec0499a20079747 P 0d05b13b8e0c4c4997c569669112117e: Deleting consensus metadata
I20260808 14:56:33.570317 19748 catalog_manager.cc:4841] TS 0d05b13b8e0c4c4997c569669112117e (127.12.73.131:40225): tablet 9dd24f45e2cc4e008ec0499a20079747 (table test-table [id=a83d23242b1645ab9cd511d743eddd70]) successfully deleted
I20260808 14:56:33.572556 20600 ts_tablet_manager.cc:1918] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:33.572734 20600 log.cc:1196] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/9dd24f45e2cc4e008ec0499a20079747
I20260808 14:56:33.573383 20600 ts_tablet_manager.cc:1939] T 9dd24f45e2cc4e008ec0499a20079747 P 0b903fbb81334d6482e08f0293360088: Deleting consensus metadata
I20260808 14:56:33.575019 19748 catalog_manager.cc:4841] TS 0b903fbb81334d6482e08f0293360088 (127.12.73.130:42263): tablet 9dd24f45e2cc4e008ec0499a20079747 (table test-table [id=a83d23242b1645ab9cd511d743eddd70]) successfully deleted
I20260808 14:56:33.575187 20568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.541097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.12.73.129:34079)
0808 14:56:33.541350 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:33.541359 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:33.552954 (+ 11595us) server_negotiation.cc:407] Connection header received
0808 14:56:33.553449 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:33.553454 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:33.553556 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:33.553633 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:33.555438 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.556668 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.559039 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.559965 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.560087 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.567781 (+ 7694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:33.567797 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:33.567814 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:33.567861 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:33.571797 (+ 3936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:33.572722 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:33.572732 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:33.572736 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:33.572926 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:33.573451 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:33.573456 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:33.573460 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:33.573928 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:33.574280 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:33.574570 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 14:56:33.574800 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 14:56:33.575887 20074 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:33.667483 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 19876
I20260808 14:56:33.696455 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 20091
Aug 08 14:56:33 dist-test-slave-z8x9 krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:56:33.712360 20562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.697356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40540 (local address 127.12.73.130:42263)
0808 14:56:33.697553 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:33.697559 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:33.697582 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:56:33.697653 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:33.697660 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:33.697752 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:33.697865 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:33.699074 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.700268 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.701631 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.702217 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.702355 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.706601 (+ 4246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:33.706617 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:33.706634 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:33.706670 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:33.709580 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:33.710264 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:33.710272 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:33.710274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:33.710413 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:33.710802 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:33.710806 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:33.710808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:33.711158 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:33.711467 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:33.711777 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 14:56:33.712007 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:56:33.713325 20311 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:33.803592 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 20091
I20260808 14:56:33.835073 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 20326
Aug 08 14:56:33 dist-test-slave-z8x9 krb5kdc[19699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:56:33.851995 20570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:33.835898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42034 (local address 127.12.73.131:40225)
0808 14:56:33.836097 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:33.836104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:33.836217 (+ 113us) server_negotiation.cc:407] Connection header received
0808 14:56:33.836439 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:33.836444 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:33.836513 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:33.836634 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:33.838017 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.839012 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.840303 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:33.840771 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:33.840907 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:33.845794 (+ 4887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:33.845808 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:33.845828 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:33.845868 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:33.849067 (+ 3199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:33.849817 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:33.849828 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:33.849831 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:33.850000 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:33.850400 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:33.850405 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:33.850408 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:33.850772 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:33.851113 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:33.851394 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 14:56:33.851622 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:56:33.852830 20527 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:33.976770 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 20326
I20260808 14:56:34.006407 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 19721
I20260808 14:56:34.007570 19825 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:34.123335 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 19721
2026-08-08T14:56:34Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4538 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T14:56:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:34Z Disabled control of system clock
I20260808 14:56:34.209420 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34463
--webserver_interface=127.12.73.190
--webserver_port=0
--builtin_ntp_servers=127.12.73.148:46717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:34463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:56:34.537890 20624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:34.538254 20624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:34.538383 20624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:34.545504 20624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:34.545611 20624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:34.545650 20624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:34.545707 20624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:34.545753 20624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:34.554800 20624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:34463
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:34.556046 20624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:34.557775 20624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:34.569636 20636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:34.569736 20634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:34.569707 20631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:34.570590 20624 server_base.cc:1034] running on GCE node
I20260808 14:56:34.571329 20624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:34.572566 20624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:34.573774 20624 hybrid_clock.cc:648] HybridClock initialized: now 1786200994573732 us; error 27 us; skew 500 ppm
I20260808 14:56:34.574117 20624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:56:34.576270 20624 webserver.cc:460] Webserver started at http://127.12.73.190:33579/ using document root <none> and password file <none>
I20260808 14:56:34.576967 20624 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:34.577083 20624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:34.577507 20624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:34.580265 20624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "7b1fd9b116c84b468a3b4d55dd0dcb7a"
format_stamp: "Formatted at 2026-08-08 14:56:34 on dist-test-slave-z8x9"
server_key: "e87850606296afd78dcab30fba8d3ed5"
server_key_iv: "b49decbae08138855825b67c6ba96eab"
server_key_version: "encryptionkey@0"
I20260808 14:56:34.581084 20624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "7b1fd9b116c84b468a3b4d55dd0dcb7a"
format_stamp: "Formatted at 2026-08-08 14:56:34 on dist-test-slave-z8x9"
server_key: "e87850606296afd78dcab30fba8d3ed5"
server_key_iv: "b49decbae08138855825b67c6ba96eab"
server_key_version: "encryptionkey@0"
I20260808 14:56:34.586263 20624 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:56:34.589725 20647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:34.591027 20624 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:56:34.591214 20624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "7b1fd9b116c84b468a3b4d55dd0dcb7a"
format_stamp: "Formatted at 2026-08-08 14:56:34 on dist-test-slave-z8x9"
server_key: "e87850606296afd78dcab30fba8d3ed5"
server_key_iv: "b49decbae08138855825b67c6ba96eab"
server_key_version: "encryptionkey@0"
I20260808 14:56:34.591454 20624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:34.596971 20624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:34.597813 20624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:34.598120 20624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:34.618147 20624 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:34463
I20260808 14:56:34.618175 20743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:34463 every 8 connection(s)
I20260808 14:56:34.619786 20624 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:34.623957 20744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:34.630220 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 20624
I20260808 14:56:34.630432 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:34.631394 12582 external_mini_cluster.cc:1428] Setting key c2527a4a48bc85fda7e0992590a714ff
I20260808 14:56:34.636956 20744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a: Bootstrap starting.
I20260808 14:56:34.640105 20750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:34.633881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56912 (local address 127.12.73.190:34463)
0808 14:56:34.634918 (+ 1037us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:34.634929 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:34.634972 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:56:34.636534 (+ 1562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:34.636557 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:34.636931 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:34.637406 (+ 475us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:34.638519 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:34.638525 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:34.638540 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:34.638555 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:34.638614 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:34.638638 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:34.638918 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:34.639066 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 14:56:34.639298 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":341,"threads_started":1}
I20260808 14:56:34.640604 20744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:34.642055 20744 log.cc:824] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:34.644974 20744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a: No bootstrap required, opened a new log
I20260808 14:56:34.652333 20744 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b1fd9b116c84b468a3b4d55dd0dcb7a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34463 } }
I20260808 14:56:34.652699 20744 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:34.652766 20744 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b1fd9b116c84b468a3b4d55dd0dcb7a, State: Initialized, Role: FOLLOWER
I20260808 14:56:34.653342 20744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b1fd9b116c84b468a3b4d55dd0dcb7a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34463 } }
I20260808 14:56:34.653542 20744 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:34.653641 20744 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:34.653771 20744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:34.656144 20744 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b1fd9b116c84b468a3b4d55dd0dcb7a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34463 } }
I20260808 14:56:34.656603 20744 leader_election.cc:302] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b1fd9b116c84b468a3b4d55dd0dcb7a; no voters:
I20260808 14:56:34.657316 20744 leader_election.cc:288] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:34.657480 20753 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:34.658217 20753 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [term 1 LEADER]: Becoming Leader. State: Replica: 7b1fd9b116c84b468a3b4d55dd0dcb7a, State: Running, Role: LEADER
I20260808 14:56:34.658810 20753 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b1fd9b116c84b468a3b4d55dd0dcb7a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34463 } }
I20260808 14:56:34.659386 20744 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:34.661703 20755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b1fd9b116c84b468a3b4d55dd0dcb7a. Latest consensus state: current_term: 1 leader_uuid: "7b1fd9b116c84b468a3b4d55dd0dcb7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b1fd9b116c84b468a3b4d55dd0dcb7a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34463 } } }
I20260808 14:56:34.662177 20755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:34.666277 20754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b1fd9b116c84b468a3b4d55dd0dcb7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b1fd9b116c84b468a3b4d55dd0dcb7a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34463 } } }
I20260808 14:56:34.666752 20754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:34.667192 20761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:34.673349 20761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:34.690552 20761 catalog_manager.cc:1347] Generated new cluster ID: ff11119ede224f61a944f2937fd1e03c
I20260808 14:56:34.690745 20761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:34.712474 20761 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:34.712917 20761 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:34.724486 20761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a: Generated new TSK 0
I20260808 14:56:34.725531 20761 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:56:34.739511 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34463
--builtin_ntp_servers=127.12.73.148:46717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:56:35.089910 20792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:35.090384 20792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:35.090538 20792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:35.103025 20792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:35.103181 20792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:35.103368 20792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:56:35.112732 20792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34463
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:35.114133 20792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:35.115893 20792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:35.133322 20801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:35.133342 20799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:35.134057 20806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:35.134527 20792 server_base.cc:1034] running on GCE node
I20260808 14:56:35.135142 20792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:35.136207 20792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:35.137439 20792 hybrid_clock.cc:648] HybridClock initialized: now 1786200995137372 us; error 65 us; skew 500 ppm
I20260808 14:56:35.137755 20792 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:56:35.140259 20792 webserver.cc:460] Webserver started at http://127.12.73.129:37029/ using document root <none> and password file <none>
I20260808 14:56:35.140964 20792 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:35.141098 20792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:35.141458 20792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:35.144193 20792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "2960bc6c3b864480bc2d3c5e137afb74"
format_stamp: "Formatted at 2026-08-08 14:56:35 on dist-test-slave-z8x9"
server_key: "333d791abf98fd0494311d55ed42b0a2"
server_key_iv: "eff3cb120d5148398cac07bbe6cb7073"
server_key_version: "encryptionkey@0"
I20260808 14:56:35.144990 20792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "2960bc6c3b864480bc2d3c5e137afb74"
format_stamp: "Formatted at 2026-08-08 14:56:35 on dist-test-slave-z8x9"
server_key: "333d791abf98fd0494311d55ed42b0a2"
server_key_iv: "eff3cb120d5148398cac07bbe6cb7073"
server_key_version: "encryptionkey@0"
I20260808 14:56:35.150408 20792 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 14:56:35.154202 20814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:35.155726 20792 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:56:35.155906 20792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "2960bc6c3b864480bc2d3c5e137afb74"
format_stamp: "Formatted at 2026-08-08 14:56:35 on dist-test-slave-z8x9"
server_key: "333d791abf98fd0494311d55ed42b0a2"
server_key_iv: "eff3cb120d5148398cac07bbe6cb7073"
server_key_version: "encryptionkey@0"
I20260808 14:56:35.156143 20792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:35.162048 20792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:35.162829 20792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:35.163096 20792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:35.164037 20792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:35.165702 20792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:35.165822 20792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:35.165956 20792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:35.166043 20792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:35.204298 20792 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:35623
I20260808 14:56:35.204358 21030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:35623 every 8 connection(s)
I20260808 14:56:35.205709 20792 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:56:35.215673 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 20792
I20260808 14:56:35.215922 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:56:35.216614 21036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:35.208846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:60881 (local address 127.12.73.190:34463)
0808 14:56:35.209419 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:35.209425 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:35.210889 (+ 1464us) server_negotiation.cc:407] Connection header received
0808 14:56:35.213879 (+ 2990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:35.213884 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:35.213939 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:35.214034 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:35.215712 (+ 1678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:35.215718 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:35.215721 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:35.215738 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:35.215806 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:35.215823 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:35.215943 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:35.216211 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 14:56:35.216295 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":293,"threads_started":1}
I20260808 14:56:35.216853 12582 external_mini_cluster.cc:1428] Setting key 1917533095b2d72ebe1b377fc7689a88
I20260808 14:56:35.217669 21037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:35.209401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34463 (local address 127.12.73.129:60881)
0808 14:56:35.210673 (+ 1272us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:35.210747 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:35.213517 (+ 2770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:35.214351 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:35.214364 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:35.214500 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:35.215396 (+ 896us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:56:35.215399 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:35.215436 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:56:35.215518 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:35.215926 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:35.215937 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:35.215945 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:56:35.216255 (+ 310us) client_negotiation.cc:240] Negotiation successful
0808 14:56:35.216510 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":388,"threads_started":1}
I20260808 14:56:35.219404 21031 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34463
I20260808 14:56:35.219784 21031 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:35.220217 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34463
--builtin_ntp_servers=127.12.73.148:46717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 14:56:35.220582 21031 heartbeater.cc:511] Master 127.12.73.190:34463 requested a full tablet report, sending...
I20260808 14:56:35.223196 20675 ts_manager.cc:194] Registered new tserver with Master: 2960bc6c3b864480bc2d3c5e137afb74 (127.12.73.129:35623)
W20260808 14:56:35.574831 21038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:35.575093 21038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:35.575181 21038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:35.582381 21038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:35.582472 21038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:35.582576 21038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:56:35.591339 21038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34463
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:35.592530 21038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:35.594249 21038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:35.607360 21050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:35.607388 21053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:35.607484 21051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:35.608429 21038 server_base.cc:1034] running on GCE node
I20260808 14:56:35.609045 21038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:35.609994 21038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:35.611267 21038 hybrid_clock.cc:648] HybridClock initialized: now 1786200995611209 us; error 58 us; skew 500 ppm
I20260808 14:56:35.611634 21038 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:56:35.614066 21038 webserver.cc:460] Webserver started at http://127.12.73.130:34263/ using document root <none> and password file <none>
I20260808 14:56:35.614816 21038 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:35.614959 21038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:35.615310 21038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:35.618299 21038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "3537f6a560e24c209474a91ced749996"
format_stamp: "Formatted at 2026-08-08 14:56:35 on dist-test-slave-z8x9"
server_key: "8dea160e181d900f6f8400022853974a"
server_key_iv: "d5b06b8afd8c7c08de65ea70ca0c42c3"
server_key_version: "encryptionkey@0"
I20260808 14:56:35.619149 21038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "3537f6a560e24c209474a91ced749996"
format_stamp: "Formatted at 2026-08-08 14:56:35 on dist-test-slave-z8x9"
server_key: "8dea160e181d900f6f8400022853974a"
server_key_iv: "d5b06b8afd8c7c08de65ea70ca0c42c3"
server_key_version: "encryptionkey@0"
I20260808 14:56:35.624401 21038 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 14:56:35.627935 21071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:35.629489 21038 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 14:56:35.629662 21038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "3537f6a560e24c209474a91ced749996"
format_stamp: "Formatted at 2026-08-08 14:56:35 on dist-test-slave-z8x9"
server_key: "8dea160e181d900f6f8400022853974a"
server_key_iv: "d5b06b8afd8c7c08de65ea70ca0c42c3"
server_key_version: "encryptionkey@0"
I20260808 14:56:35.629882 21038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:35.635530 21038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:35.636289 21038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:35.636579 21038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:35.637622 21038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:35.639068 21038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:35.639191 21038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:35.639333 21038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:35.639424 21038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:35.671985 21038 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:43345
I20260808 14:56:35.672102 21267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:43345 every 8 connection(s)
I20260808 14:56:35.673384 21038 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:56:35.679697 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 21038
I20260808 14:56:35.679877 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:56:35.680334 12582 external_mini_cluster.cc:1428] Setting key a7c03c243237ba2545ae2a280279bd60
I20260808 14:56:35.681560 21036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:35.675916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:47813 (local address 127.12.73.190:34463)
0808 14:56:35.676122 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:35.676128 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:35.677534 (+ 1406us) server_negotiation.cc:407] Connection header received
0808 14:56:35.679157 (+ 1623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:35.679166 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:35.679237 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:35.679354 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:35.680731 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:35.680737 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:35.680741 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:35.680760 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:35.680800 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:35.680816 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:35.680955 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:35.681167 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 14:56:35.681256 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:56:35.682622 21273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:35.676453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34463 (local address 127.12.73.130:47813)
0808 14:56:35.677390 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:35.677426 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:35.678907 (+ 1481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:35.679557 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:35.679564 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:35.679644 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:35.680389 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:56:35.680392 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:35.680456 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:56:35.680560 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:35.680935 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:35.680946 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:35.680954 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:56:35.681252 (+ 298us) client_negotiation.cc:240] Negotiation successful
0808 14:56:35.681493 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":263,"threads_started":1}
I20260808 14:56:35.683473 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34463
--builtin_ntp_servers=127.12.73.148:46717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 14:56:35.683947 21269 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34463
I20260808 14:56:35.684239 21269 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:35.684787 21269 heartbeater.cc:511] Master 127.12.73.190:34463 requested a full tablet report, sending...
I20260808 14:56:35.686158 20675 ts_manager.cc:194] Registered new tserver with Master: 3537f6a560e24c209474a91ced749996 (127.12.73.130:43345)
W20260808 14:56:36.014377 21274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:36.014696 21274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:36.014859 21274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:36.022765 21274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:36.022898 21274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:36.023077 21274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:56:36.032111 21274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34463
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:36.033447 21274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:36.035262 21274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:36.048581 21284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:36.048699 21286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:36.048538 21288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:36.049362 21274 server_base.cc:1034] running on GCE node
I20260808 14:56:36.049937 21274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:36.050800 21274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:36.052034 21274 hybrid_clock.cc:648] HybridClock initialized: now 1786200996051996 us; error 51 us; skew 500 ppm
I20260808 14:56:36.052359 21274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:56:36.054608 21274 webserver.cc:460] Webserver started at http://127.12.73.131:45077/ using document root <none> and password file <none>
I20260808 14:56:36.055311 21274 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:36.055457 21274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:36.055876 21274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:36.058836 21274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "a5db44bb53d44cea823b5fe3b1f9db75"
format_stamp: "Formatted at 2026-08-08 14:56:36 on dist-test-slave-z8x9"
server_key: "fa7ccf5d7a96056f77375ebd2cc6f63f"
server_key_iv: "93d1e689fdca2e0c73ed597daf89fb7a"
server_key_version: "encryptionkey@0"
I20260808 14:56:36.059698 21274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "a5db44bb53d44cea823b5fe3b1f9db75"
format_stamp: "Formatted at 2026-08-08 14:56:36 on dist-test-slave-z8x9"
server_key: "fa7ccf5d7a96056f77375ebd2cc6f63f"
server_key_iv: "93d1e689fdca2e0c73ed597daf89fb7a"
server_key_version: "encryptionkey@0"
I20260808 14:56:36.064842 21274 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:56:36.068562 21298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:36.069926 21274 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:56:36.070106 21274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "a5db44bb53d44cea823b5fe3b1f9db75"
format_stamp: "Formatted at 2026-08-08 14:56:36 on dist-test-slave-z8x9"
server_key: "fa7ccf5d7a96056f77375ebd2cc6f63f"
server_key_iv: "93d1e689fdca2e0c73ed597daf89fb7a"
server_key_version: "encryptionkey@0"
I20260808 14:56:36.070348 21274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:36.076186 21274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:36.077013 21274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:36.077387 21274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:36.078289 21274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:36.079668 21274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:36.079792 21274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:36.079923 21274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:36.080011 21274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:36.114916 21274 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:39705
I20260808 14:56:36.115011 21503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:39705 every 8 connection(s)
I20260808 14:56:36.116298 21274 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:56:36.116966 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 21274
I20260808 14:56:36.117187 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:56:36.117821 12582 external_mini_cluster.cc:1428] Setting key d056e57750bc2f455d1d749706ecdc15
I20260808 14:56:36.125015 21036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.119546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:60235 (local address 127.12.73.190:34463)
0808 14:56:36.119757 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:36.119762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:36.121463 (+ 1701us) server_negotiation.cc:407] Connection header received
0808 14:56:36.123056 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:36.123061 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:36.123112 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:36.123196 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:36.124455 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:36.124460 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:36.124463 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:36.124475 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:36.124501 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:36.124512 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:36.124607 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:36.124769 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 14:56:36.124815 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:56:36.125955 21507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.120204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34463 (local address 127.12.73.131:60235)
0808 14:56:36.121310 (+ 1106us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.121354 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:36.122827 (+ 1473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:36.123390 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:36.123398 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:36.123480 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:36.124186 (+ 706us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:56:36.124188 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:36.124226 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:56:36.124308 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:36.124597 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:36.124605 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:36.124610 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:56:36.124812 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 14:56:36.125004 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":314,"threads_started":1}
I20260808 14:56:36.127337 21504 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34463
I20260808 14:56:36.127595 21504 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:36.128098 21504 heartbeater.cc:511] Master 127.12.73.190:34463 requested a full tablet report, sending...
I20260808 14:56:36.129426 20675 ts_manager.cc:194] Registered new tserver with Master: a5db44bb53d44cea823b5fe3b1f9db75 (127.12.73.131:39705)
I20260808 14:56:36.133400 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:56:36.140596 21036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.138068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56920 (local address 127.12.73.190:34463)
0808 14:56:36.138307 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:36.138315 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:36.138708 (+ 393us) server_negotiation.cc:407] Connection header received
0808 14:56:36.138906 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:36.138912 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:36.138970 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:36.139073 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:36.139961 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:36.139967 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:36.139972 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:36.139989 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:36.140031 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:36.140043 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:36.140185 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:36.140265 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 14:56:36.140326 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:56:36.144352 20675 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:56:36.151149 20675 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:36.180540 21521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.162863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:35623 (local address 127.0.0.1:42950)
0808 14:56:36.163672 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.163729 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:36.163883 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:36.177558 (+ 13675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:36.177570 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:36.177694 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:36.178962 (+ 1268us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:56:36.178968 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:36.179004 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:56:36.179109 (+ 105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:36.179719 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:36.179734 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:36.179745 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 14:56:36.179936 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 14:56:36.180035 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":15707,"threads_started":1}
I20260808 14:56:36.181051 21525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.163593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42950 (local address 127.12.73.129:35623)
0808 14:56:36.174196 (+ 10603us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:36.174211 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:36.174258 (+ 47us) server_negotiation.cc:407] Connection header received
0808 14:56:36.174355 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:36.174368 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:36.175939 (+ 1571us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:36.176145 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:36.179346 (+ 3201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:36.179356 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:36.179371 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:36.179391 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:36.179474 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:36.179509 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:36.179656 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:36.180593 (+ 937us) server_negotiation.cc:299] Negotiation successful
0808 14:56:36.180727 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10327,"thread_start_us":10181,"threads_started":1}
I20260808 14:56:36.181107 21526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.162909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:43345 (local address 127.0.0.1:56818)
0808 14:56:36.175167 (+ 12258us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.175211 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:36.175349 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:36.179109 (+ 3760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:36.179118 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:36.179154 (+ 36us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:36.179979 (+ 825us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:56:36.179983 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:36.180000 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:56:36.180046 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:36.180411 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:36.180418 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:36.180423 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:56:36.180612 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 14:56:36.180671 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12016,"thread_start_us":480,"threads_started":1}
I20260808 14:56:36.181818 21523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.163020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56818 (local address 127.12.73.130:43345)
0808 14:56:36.178256 (+ 15236us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:36.178269 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:36.178305 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:56:36.178396 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:36.178406 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:36.178632 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:36.179078 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:36.180164 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:36.180174 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:36.180187 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:36.180211 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:36.180263 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:36.180284 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:36.180455 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:36.181088 (+ 633us) server_negotiation.cc:299] Negotiation successful
0808 14:56:36.181412 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15016,"thread_start_us":15734,"threads_started":1}
I20260808 14:56:36.183949 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.164370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:39705 (local address 127.0.0.1:44080)
0808 14:56:36.178582 (+ 14212us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.178606 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:36.178710 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:36.181193 (+ 2483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:36.181198 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:36.181222 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:36.181937 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:56:36.181940 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:36.181954 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:56:36.181994 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:36.183329 (+ 1335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:36.183334 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:36.183339 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:56:36.183464 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:56:36.183517 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14083,"thread_start_us":11080,"threads_started":1}
I20260808 14:56:36.184872 21527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.164729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44080 (local address 127.12.73.131:39705)
0808 14:56:36.180208 (+ 15479us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:36.180215 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:36.180241 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:56:36.180293 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:36.180298 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:36.180506 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:36.181641 (+ 1135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:36.183089 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:36.183098 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:36.183110 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:36.183127 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:36.183177 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:36.183196 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:36.184337 (+ 1141us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:36.184407 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 14:56:36.184498 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15276,"thread_start_us":16135,"threads_started":1}
I20260808 14:56:36.185477 20912 tablet_service.cc:1467] Processing CreateTablet for tablet 15cf96f49121465696bc5e6ccc377c12 (DEFAULT_TABLE table=test-table [id=67b160503654455888724360e55dcbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:36.185460 21158 tablet_service.cc:1467] Processing CreateTablet for tablet 15cf96f49121465696bc5e6ccc377c12 (DEFAULT_TABLE table=test-table [id=67b160503654455888724360e55dcbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:36.186775 20912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15cf96f49121465696bc5e6ccc377c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:36.186898 21158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15cf96f49121465696bc5e6ccc377c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:36.188622 21389 tablet_service.cc:1467] Processing CreateTablet for tablet 15cf96f49121465696bc5e6ccc377c12 (DEFAULT_TABLE table=test-table [id=67b160503654455888724360e55dcbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:36.190198 21389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15cf96f49121465696bc5e6ccc377c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:36.198390 21528 tablet_bootstrap.cc:492] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74: Bootstrap starting.
I20260808 14:56:36.201589 21528 tablet_bootstrap.cc:654] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:36.202505 21531 tablet_bootstrap.cc:492] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996: Bootstrap starting.
I20260808 14:56:36.202976 21528 log.cc:824] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:36.206295 21528 tablet_bootstrap.cc:492] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74: No bootstrap required, opened a new log
I20260808 14:56:36.206347 21531 tablet_bootstrap.cc:654] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:36.206605 21528 ts_tablet_manager.cc:1397] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20260808 14:56:36.208030 21531 log.cc:824] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:36.210062 21537 tablet_bootstrap.cc:492] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75: Bootstrap starting.
I20260808 14:56:36.211689 21531 tablet_bootstrap.cc:492] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996: No bootstrap required, opened a new log
I20260808 14:56:36.211961 21531 ts_tablet_manager.cc:1397] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.001s
I20260808 14:56:36.213505 21537 tablet_bootstrap.cc:654] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:36.214699 21537 log.cc:824] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:36.218266 21528 raft_consensus.cc:348] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3537f6a560e24c209474a91ced749996" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43345 } } peers { permanent_uuid: "2960bc6c3b864480bc2d3c5e137afb74" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35623 } } peers { permanent_uuid: "a5db44bb53d44cea823b5fe3b1f9db75" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39705 } }
I20260808 14:56:36.218892 21528 raft_consensus.cc:374] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:36.219058 21528 raft_consensus.cc:729] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2960bc6c3b864480bc2d3c5e137afb74, State: Initialized, Role: FOLLOWER
I20260808 14:56:36.219877 21528 consensus_queue.cc:260] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3537f6a560e24c209474a91ced749996" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43345 } } peers { permanent_uuid: "2960bc6c3b864480bc2d3c5e137afb74" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35623 } } peers { permanent_uuid: "a5db44bb53d44cea823b5fe3b1f9db75" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39705 } }
I20260808 14:56:36.223619 21531 raft_consensus.cc:348] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3537f6a560e24c209474a91ced749996" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43345 } } peers { permanent_uuid: "2960bc6c3b864480bc2d3c5e137afb74" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35623 } } peers { permanent_uuid: "a5db44bb53d44cea823b5fe3b1f9db75" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39705 } }
I20260808 14:56:36.224277 21531 raft_consensus.cc:374] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:36.225301 21531 raft_consensus.cc:729] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3537f6a560e24c209474a91ced749996, State: Initialized, Role: FOLLOWER
I20260808 14:56:36.226012 21531 consensus_queue.cc:260] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3537f6a560e24c209474a91ced749996" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43345 } } peers { permanent_uuid: "2960bc6c3b864480bc2d3c5e137afb74" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35623 } } peers { permanent_uuid: "a5db44bb53d44cea823b5fe3b1f9db75" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39705 } }
I20260808 14:56:36.227032 21031 heartbeater.cc:503] Master 127.12.73.190:34463 was elected leader, sending a full tablet report...
I20260808 14:56:36.227460 21269 heartbeater.cc:503] Master 127.12.73.190:34463 was elected leader, sending a full tablet report...
I20260808 14:56:36.227897 21531 ts_tablet_manager.cc:1428] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996: Time spent starting tablet: real 0.016s user 0.008s sys 0.008s
I20260808 14:56:36.229471 21537 tablet_bootstrap.cc:492] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75: No bootstrap required, opened a new log
I20260808 14:56:36.229799 21537 ts_tablet_manager.cc:1397] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.006s
I20260808 14:56:36.232080 21528 ts_tablet_manager.cc:1428] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74: Time spent starting tablet: real 0.025s user 0.019s sys 0.004s
I20260808 14:56:36.238489 21537 raft_consensus.cc:348] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3537f6a560e24c209474a91ced749996" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43345 } } peers { permanent_uuid: "2960bc6c3b864480bc2d3c5e137afb74" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35623 } } peers { permanent_uuid: "a5db44bb53d44cea823b5fe3b1f9db75" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39705 } }
I20260808 14:56:36.238875 21537 raft_consensus.cc:374] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:36.239001 21537 raft_consensus.cc:729] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5db44bb53d44cea823b5fe3b1f9db75, State: Initialized, Role: FOLLOWER
I20260808 14:56:36.239526 21537 consensus_queue.cc:260] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3537f6a560e24c209474a91ced749996" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43345 } } peers { permanent_uuid: "2960bc6c3b864480bc2d3c5e137afb74" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35623 } } peers { permanent_uuid: "a5db44bb53d44cea823b5fe3b1f9db75" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39705 } }
I20260808 14:56:36.240589 21504 heartbeater.cc:503] Master 127.12.73.190:34463 was elected leader, sending a full tablet report...
I20260808 14:56:36.240983 21537 ts_tablet_manager.cc:1428] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260808 14:56:36.283445 21540 raft_consensus.cc:482] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:36.283747 21540 raft_consensus.cc:504] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3537f6a560e24c209474a91ced749996" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43345 } } peers { permanent_uuid: "2960bc6c3b864480bc2d3c5e137afb74" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35623 } } peers { permanent_uuid: "a5db44bb53d44cea823b5fe3b1f9db75" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39705 } }
I20260808 14:56:36.285398 21540 leader_election.cc:288] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3537f6a560e24c209474a91ced749996 (127.12.73.130:43345), a5db44bb53d44cea823b5fe3b1f9db75 (127.12.73.131:39705)
I20260808 14:56:36.288843 21523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.285872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:49049 (local address 127.12.73.130:43345)
0808 14:56:36.286052 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:36.286056 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:36.286683 (+ 627us) server_negotiation.cc:407] Connection header received
0808 14:56:36.286868 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:36.286877 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:36.286965 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:36.287085 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:36.288228 (+ 1143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:36.288232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:36.288235 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:36.288250 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:36.288309 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:36.288326 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:36.288452 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:36.288535 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 14:56:36.288605 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:56:36.289105 21545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.285895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:43345 (local address 127.12.73.129:49049)
0808 14:56:36.286514 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.286557 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:36.286705 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:36.287192 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:36.287197 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:36.287225 (+ 28us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:36.287999 (+ 774us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:56:36.288001 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:36.288019 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:56:36.288060 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:36.288439 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:36.288442 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:36.288446 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:56:36.288560 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 14:56:36.288638 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":327,"threads_started":1}
I20260808 14:56:36.289428 21527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.286917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:58949 (local address 127.12.73.131:39705)
0808 14:56:36.287117 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:36.287125 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:36.287380 (+ 255us) server_negotiation.cc:407] Connection header received
0808 14:56:36.287576 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:36.287580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:36.287628 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:36.287729 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:36.288680 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:36.288686 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:36.288690 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:36.288709 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:36.288750 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:36.288770 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:36.288894 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:36.289094 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 14:56:36.289160 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 14:56:36.290194 21548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.286603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:39705 (local address 127.12.73.129:58949)
0808 14:56:36.287266 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.287278 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:36.287422 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:36.287749 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:36.287754 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:36.287776 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:36.288442 (+ 666us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:56:36.288446 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:36.288463 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:56:36.288513 (+ 50us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:36.288884 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:36.288889 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:36.288897 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:56:36.289739 (+ 842us) client_negotiation.cc:240] Negotiation successful
0808 14:56:36.289794 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":325,"threads_started":1}
I20260808 14:56:36.290330 21202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cf96f49121465696bc5e6ccc377c12" candidate_uuid: "2960bc6c3b864480bc2d3c5e137afb74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3537f6a560e24c209474a91ced749996" is_pre_election: true
I20260808 14:56:36.290958 21202 raft_consensus.cc:2454] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2960bc6c3b864480bc2d3c5e137afb74 in term 0.
I20260808 14:56:36.291211 21421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cf96f49121465696bc5e6ccc377c12" candidate_uuid: "2960bc6c3b864480bc2d3c5e137afb74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5db44bb53d44cea823b5fe3b1f9db75" is_pre_election: true
I20260808 14:56:36.291694 20817 leader_election.cc:302] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2960bc6c3b864480bc2d3c5e137afb74, 3537f6a560e24c209474a91ced749996; no voters:
I20260808 14:56:36.291755 21421 raft_consensus.cc:2454] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2960bc6c3b864480bc2d3c5e137afb74 in term 0.
I20260808 14:56:36.292095 21540 raft_consensus.cc:2781] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:36.292264 21540 raft_consensus.cc:482] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:36.292393 21540 raft_consensus.cc:3037] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:36.294739 21540 raft_consensus.cc:504] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3537f6a560e24c209474a91ced749996" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43345 } } peers { permanent_uuid: "2960bc6c3b864480bc2d3c5e137afb74" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35623 } } peers { permanent_uuid: "a5db44bb53d44cea823b5fe3b1f9db75" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39705 } }
I20260808 14:56:36.295315 21540 leader_election.cc:288] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [CANDIDATE]: Term 1 election: Requested vote from peers 3537f6a560e24c209474a91ced749996 (127.12.73.130:43345), a5db44bb53d44cea823b5fe3b1f9db75 (127.12.73.131:39705)
I20260808 14:56:36.295785 21202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cf96f49121465696bc5e6ccc377c12" candidate_uuid: "2960bc6c3b864480bc2d3c5e137afb74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3537f6a560e24c209474a91ced749996"
I20260808 14:56:36.295866 21421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cf96f49121465696bc5e6ccc377c12" candidate_uuid: "2960bc6c3b864480bc2d3c5e137afb74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5db44bb53d44cea823b5fe3b1f9db75"
I20260808 14:56:36.296005 21202 raft_consensus.cc:3037] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:36.296048 21421 raft_consensus.cc:3037] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:36.299369 21202 raft_consensus.cc:2454] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2960bc6c3b864480bc2d3c5e137afb74 in term 1.
I20260808 14:56:36.299376 21421 raft_consensus.cc:2454] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2960bc6c3b864480bc2d3c5e137afb74 in term 1.
I20260808 14:56:36.299749 20817 leader_election.cc:302] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2960bc6c3b864480bc2d3c5e137afb74, 3537f6a560e24c209474a91ced749996; no voters:
I20260808 14:56:36.300060 21540 raft_consensus.cc:2781] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:36.300501 21540 raft_consensus.cc:686] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 1 LEADER]: Becoming Leader. State: Replica: 2960bc6c3b864480bc2d3c5e137afb74, State: Running, Role: LEADER
I20260808 14:56:36.300977 21540 consensus_queue.cc:237] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3537f6a560e24c209474a91ced749996" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43345 } } peers { permanent_uuid: "2960bc6c3b864480bc2d3c5e137afb74" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35623 } } peers { permanent_uuid: "a5db44bb53d44cea823b5fe3b1f9db75" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39705 } }
I20260808 14:56:36.305759 20674 catalog_manager.cc:5495] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2960bc6c3b864480bc2d3c5e137afb74 (127.12.73.129). New cstate: current_term: 1 leader_uuid: "2960bc6c3b864480bc2d3c5e137afb74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3537f6a560e24c209474a91ced749996" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2960bc6c3b864480bc2d3c5e137afb74" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 35623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5db44bb53d44cea823b5fe3b1f9db75" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39705 } health_report { overall_health: UNKNOWN } } }
I20260808 14:56:36.329033 21525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.326804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42960 (local address 127.12.73.129:35623)
0808 14:56:36.326990 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:36.326997 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:36.327094 (+ 97us) server_negotiation.cc:407] Connection header received
0808 14:56:36.327339 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:36.327344 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:36.327421 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:36.327530 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:36.328386 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:36.328392 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:36.328397 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:36.328414 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:36.328467 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:36.328480 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:36.328602 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:36.328690 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 14:56:36.328752 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:56:36.337155 21202 raft_consensus.cc:1261] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996 [term 1 FOLLOWER]: Refusing update from remote peer 2960bc6c3b864480bc2d3c5e137afb74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:36.337327 21421 raft_consensus.cc:1261] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75 [term 1 FOLLOWER]: Refusing update from remote peer 2960bc6c3b864480bc2d3c5e137afb74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:36.338228 21540 consensus_queue.cc:1035] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3537f6a560e24c209474a91ced749996" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:36.338558 21549 consensus_queue.cc:1035] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5db44bb53d44cea823b5fe3b1f9db75" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:36.350220 21554 mvcc.cc:205] Tried to move back new op lower bound from 7316279280987193344 to 7316279280852832256. Current Snapshot: MvccSnapshot[applied={T|T < 7316279280987193344}]
I20260808 14:56:36.364636 20674 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:36.364916 20674 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:36.368517 20674 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b1fd9b116c84b468a3b4d55dd0dcb7a: Sending DeleteTablet for 3 replicas of tablet 15cf96f49121465696bc5e6ccc377c12
I20260808 14:56:36.369652 20912 tablet_service.cc:1514] Processing DeleteTablet for tablet 15cf96f49121465696bc5e6ccc377c12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:36 UTC) from {username='slave'} at 127.0.0.1:42950
I20260808 14:56:36.369673 21158 tablet_service.cc:1514] Processing DeleteTablet for tablet 15cf96f49121465696bc5e6ccc377c12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:36 UTC) from {username='slave'} at 127.0.0.1:56818
I20260808 14:56:36.370458 21389 tablet_service.cc:1514] Processing DeleteTablet for tablet 15cf96f49121465696bc5e6ccc377c12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:36 UTC) from {username='slave'} at 127.0.0.1:44080
I20260808 14:56:36.373638 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 20792
I20260808 14:56:36.381486 21571 tablet_replica.cc:330] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75: stopping tablet replica
I20260808 14:56:36.382038 21571 raft_consensus.cc:2229] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:36.382624 21571 raft_consensus.cc:2258] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:36.385352 21571 ts_tablet_manager.cc:1905] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:36.393877 21567 tablet_replica.cc:330] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74: stopping tablet replica
I20260808 14:56:36.394454 21567 raft_consensus.cc:2229] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:56:36.395717 21569 tablet_replica.cc:330] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996: stopping tablet replica
I20260808 14:56:36.395809 21567 raft_consensus.cc:2258] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:36.396296 21569 raft_consensus.cc:2229] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:36.396831 21569 raft_consensus.cc:2258] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:36.397895 21525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.375072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42968 (local address 127.12.73.129:35623)
0808 14:56:36.375239 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:36.375246 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:36.393783 (+ 18537us) server_negotiation.cc:407] Connection header received
0808 14:56:36.394429 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:36.394440 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:36.394507 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:36.394603 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:36.396100 (+ 1497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:36.396106 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:36.396111 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:36.396132 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:36.396179 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:36.396198 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:36.396332 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:36.397460 (+ 1128us) server_negotiation.cc:299] Negotiation successful
0808 14:56:36.397528 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 14:56:36.398258 21567 ts_tablet_manager.cc:1905] T 15cf96f49121465696bc5e6ccc377c12 P 2960bc6c3b864480bc2d3c5e137afb74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:36.399088 21569 ts_tablet_manager.cc:1905] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:36.399212 21024 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:36.405402 21571 ts_tablet_manager.cc:1918] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:36.405611 21571 log.cc:1196] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/15cf96f49121465696bc5e6ccc377c12
I20260808 14:56:36.406234 21571 ts_tablet_manager.cc:1939] T 15cf96f49121465696bc5e6ccc377c12 P a5db44bb53d44cea823b5fe3b1f9db75: Deleting consensus metadata
I20260808 14:56:36.406872 21569 ts_tablet_manager.cc:1918] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:36.407047 21569 log.cc:1196] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/15cf96f49121465696bc5e6ccc377c12
I20260808 14:56:36.407608 21569 ts_tablet_manager.cc:1939] T 15cf96f49121465696bc5e6ccc377c12 P 3537f6a560e24c209474a91ced749996: Deleting consensus metadata
I20260808 14:56:36.407994 20649 catalog_manager.cc:4841] TS a5db44bb53d44cea823b5fe3b1f9db75 (127.12.73.131:39705): tablet 15cf96f49121465696bc5e6ccc377c12 (table test-table [id=67b160503654455888724360e55dcbed]) successfully deleted
I20260808 14:56:36.409857 20649 catalog_manager.cc:4841] TS 3537f6a560e24c209474a91ced749996 (127.12.73.130:43345): tablet 15cf96f49121465696bc5e6ccc377c12 (table test-table [id=67b160503654455888724360e55dcbed]) successfully deleted
I20260808 14:56:36.497697 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 20792
I20260808 14:56:36.523825 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 21038
W20260808 14:56:36.523780 20654 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.73.129:35623 (error 108)
I20260808 14:56:36.525918 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.525386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:35623 (local address 127.0.0.1:42970)
0808 14:56:36.525574 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.525728 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260808 14:56:36.526190 20654 catalog_manager.cc:4584] TS 2960bc6c3b864480bc2d3c5e137afb74 (127.12.73.129:35623): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 15cf96f49121465696bc5e6ccc377c12: Network error: Client connection negotiation failed: client connection to 127.12.73.129:35623: connect: Connection refused (error 111)
I20260808 14:56:36.527029 21523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.524680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56828 (local address 127.12.73.130:43345)
0808 14:56:36.524901 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:36.524907 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:36.524931 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:56:36.525104 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:36.525110 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:36.525250 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:36.525353 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:36.526375 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:36.526381 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:36.526385 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:36.526402 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:36.526441 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:36.526455 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:36.526602 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:36.526684 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 14:56:36.526745 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:56:36.527657 21261 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:36.579725 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.579239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:35623 (local address 127.0.0.1:42982)
0808 14:56:36.579458 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.579557 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 14:56:36.580813 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.580464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:35623 (local address 127.0.0.1:42990)
0808 14:56:36.580615 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.580695 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 14:56:36.616199 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 21038
I20260808 14:56:36.641517 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.640991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:35623 (local address 127.0.0.1:42992)
0808 14:56:36.641260 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.641369 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 14:56:36.642506 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.642153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:35623 (local address 127.0.0.1:43002)
0808 14:56:36.642304 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.642391 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 14:56:36.646986 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 21274
I20260808 14:56:36.649614 21527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.647656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44092 (local address 127.12.73.131:39705)
0808 14:56:36.647841 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:36.647846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:36.647866 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:56:36.647958 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:36.647962 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:36.648042 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:36.648124 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:36.648917 (+ 793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:36.648922 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:36.648925 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:36.648939 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:36.648970 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:36.648982 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:36.649086 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:36.649158 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 14:56:36.649341 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:56:36.650226 21493 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:36.723080 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.722593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:35623 (local address 127.0.0.1:43010)
0808 14:56:36.722839 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.722933 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 14:56:36.724131 21520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:36.723734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:35623 (local address 127.0.0.1:43018)
0808 14:56:36.723950 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:36.724017 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:35623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260808 14:56:36.739105 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 21274
I20260808 14:56:36.766709 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 20624
I20260808 14:56:36.767865 20732 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:36.876247 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 20624
2026-08-08T14:56:36Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2747 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 14:56:36.924495 12582 mini_oidc.cc:152] Starting JWKS server
I20260808 14:56:36.927440 12582 webserver.cc:460] Webserver started at https://127.0.0.1:35119/ using document root <none> and password file <none>
I20260808 14:56:36.927841 12582 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:56:36.928508 12582 webserver.cc:460] Webserver started at http://127.0.0.1:40835/ using document root <none> and password file <none>
2026-08-08T14:56:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:36Z Disabled control of system clock
I20260808 14:56:36.963580 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:43747
--webserver_interface=127.12.73.190
--webserver_port=0
--builtin_ntp_servers=127.12.73.148:34311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:43747
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35119/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/testchainca.cert with env {}
W20260808 14:56:37.288709 21591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:37.289048 21591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:37.289279 21591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:37.296288 21591 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:37.296427 21591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:37.296516 21591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:37.296617 21591 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:37.296702 21591 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:56:37.296789 21591 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:56:37.296865 21591 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35119/jwks.json
I20260808 14:56:37.307086 21591 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:43747
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:43747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35119/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:37.308351 21591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:37.309638 21591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:37.321192 21598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:37.321211 21605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:37.321286 21600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:37.322183 21591 server_base.cc:1034] running on GCE node
I20260808 14:56:37.322929 21591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:37.324193 21591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:37.325419 21591 hybrid_clock.cc:648] HybridClock initialized: now 1786200997325386 us; error 44 us; skew 500 ppm
I20260808 14:56:37.325759 21591 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:56:37.327935 21591 webserver.cc:460] Webserver started at http://127.12.73.190:44141/ using document root <none> and password file <none>
I20260808 14:56:37.328581 21591 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:37.328722 21591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:37.329102 21591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:37.331864 21591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "cea3e351265b4470ad5d39c40cd9b1ff"
format_stamp: "Formatted at 2026-08-08 14:56:37 on dist-test-slave-z8x9"
server_key: "8dfda0de3a08b5986f0f9f84dfe1dc68"
server_key_iv: "7a33e45d1686e560b0a349be2881a002"
server_key_version: "encryptionkey@0"
I20260808 14:56:37.332646 21591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "cea3e351265b4470ad5d39c40cd9b1ff"
format_stamp: "Formatted at 2026-08-08 14:56:37 on dist-test-slave-z8x9"
server_key: "8dfda0de3a08b5986f0f9f84dfe1dc68"
server_key_iv: "7a33e45d1686e560b0a349be2881a002"
server_key_version: "encryptionkey@0"
I20260808 14:56:37.337656 21591 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 14:56:37.340976 21613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:37.342289 21591 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:37.342487 21591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "cea3e351265b4470ad5d39c40cd9b1ff"
format_stamp: "Formatted at 2026-08-08 14:56:37 on dist-test-slave-z8x9"
server_key: "8dfda0de3a08b5986f0f9f84dfe1dc68"
server_key_iv: "7a33e45d1686e560b0a349be2881a002"
server_key_version: "encryptionkey@0"
I20260808 14:56:37.342708 21591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:37.372293 21591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:37.373260 21591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:37.373601 21591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:37.392874 21591 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:43747
I20260808 14:56:37.392892 21687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:43747 every 8 connection(s)
I20260808 14:56:37.394299 21591 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:37.398023 21688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:37.404600 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 21591
I20260808 14:56:37.404845 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:37.405766 12582 external_mini_cluster.cc:1428] Setting key a7d78af410229fb24525b5aef5cbf642
I20260808 14:56:37.409535 21688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff: Bootstrap starting.
I20260808 14:56:37.412830 21688 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:37.414110 21688 log.cc:824] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:37.417367 21688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff: No bootstrap required, opened a new log
I20260808 14:56:37.419752 21696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:37.407780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37440 (local address 127.12.73.190:43747)
0808 14:56:37.408737 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:37.408748 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:37.408789 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:56:37.410540 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:37.410561 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:37.411027 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:37.411362 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:37.411971 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:37.413325 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:37.415130 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:37.415867 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:37.416012 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:37.417413 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:37.417446 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:37.417467 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:37.418035 (+ 568us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:37.418124 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:37.418146 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:37.418232 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:37.418475 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 14:56:37.418796 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":359,"threads_started":1}
I20260808 14:56:37.423501 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:56:37.425482 21688 raft_consensus.cc:348] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea3e351265b4470ad5d39c40cd9b1ff" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43747 } }
I20260808 14:56:37.425951 21688 raft_consensus.cc:374] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:37.426091 21688 raft_consensus.cc:729] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cea3e351265b4470ad5d39c40cd9b1ff, State: Initialized, Role: FOLLOWER
I20260808 14:56:37.426642 21688 consensus_queue.cc:260] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea3e351265b4470ad5d39c40cd9b1ff" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43747 } }
I20260808 14:56:37.426939 21688 raft_consensus.cc:388] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:37.427078 21688 raft_consensus.cc:482] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:37.427207 21688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:37.429425 21688 raft_consensus.cc:504] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea3e351265b4470ad5d39c40cd9b1ff" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43747 } }
I20260808 14:56:37.429868 21688 leader_election.cc:302] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cea3e351265b4470ad5d39c40cd9b1ff; no voters:
I20260808 14:56:37.430446 21688 leader_election.cc:288] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:37.430538 21700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:37.431411 21700 raft_consensus.cc:686] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [term 1 LEADER]: Becoming Leader. State: Replica: cea3e351265b4470ad5d39c40cd9b1ff, State: Running, Role: LEADER
I20260808 14:56:37.432410 21700 consensus_queue.cc:237] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea3e351265b4470ad5d39c40cd9b1ff" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43747 } }
I20260808 14:56:37.432703 21688 sys_catalog.cc:564] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:37.435247 21701 sys_catalog.cc:455] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cea3e351265b4470ad5d39c40cd9b1ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea3e351265b4470ad5d39c40cd9b1ff" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43747 } } }
I20260808 14:56:37.435592 21701 sys_catalog.cc:458] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:37.437395 21702 sys_catalog.cc:455] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader cea3e351265b4470ad5d39c40cd9b1ff. Latest consensus state: current_term: 1 leader_uuid: "cea3e351265b4470ad5d39c40cd9b1ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea3e351265b4470ad5d39c40cd9b1ff" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43747 } } }
I20260808 14:56:37.437669 21702 sys_catalog.cc:458] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:37.442262 21710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:37.447718 21710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:37.455802 21710 catalog_manager.cc:1347] Generated new cluster ID: 543f52a0155d43d8a377b8b5ea85b789
I20260808 14:56:37.455925 21710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:37.466225 21710 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:37.467960 21710 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:37.478792 21710 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cea3e351265b4470ad5d39c40cd9b1ff: Generated new TSK 0
I20260808 14:56:37.479799 21710 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 14:56:37.526033 21736 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 14:56:37.526281 21736 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:56:37.527544 21696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:37.504892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37448 (local address 127.12.73.190:43747)
0808 14:56:37.505109 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:37.505116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:37.505567 (+ 451us) server_negotiation.cc:407] Connection header received
0808 14:56:37.505880 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:37.505886 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:37.505969 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:37.506126 (+ 157us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:56:37.506607 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:37.507752 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:37.509115 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:37.509827 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:37.509959 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:37.510420 (+ 461us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:56:37.526835 (+ 16415us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 14:56:37.527238 (+ 403us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37448: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 14:56:37.527661 21696 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37448: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 14:56:37.528993 21734 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:56:37.504739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:43747 (local address 127.0.0.1:37448)
0808 14:56:37.505472 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:37.505488 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:37.505631 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:37.506150 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:37.506153 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:37.506162 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:56:37.506462 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:37.506469 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:37.507891 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:37.507895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:37.508981 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:37.508991 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:37.509975 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:37.509980 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:37.510113 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:37.510165 (+ 52us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:56:37.527131 (+ 16966us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 14:56:37.527408 (+ 277us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.73.190:43747: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":376,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.73.190:43747: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35119/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 14:56:37.531225 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 21591
I20260808 14:56:37.532456 21677 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:37.626369 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 21591
2026-08-08T14:56:37Z chronyd exiting
I20260808 14:56:37.684415 12582 test_util.cc:175] -----------------------------------------------
I20260808 14:56:37.684597 12582 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200952883082-12582-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (764 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 14:56:37.688583 12582 mini_oidc.cc:152] Starting JWKS server
I20260808 14:56:37.690471 12582 webserver.cc:460] Webserver started at https://127.0.0.1:36323/ using document root <none> and password file <none>
I20260808 14:56:37.690718 12582 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:56:37.691429 12582 webserver.cc:460] Webserver started at http://127.0.0.1:45787/ using document root <none> and password file <none>
2026-08-08T14:56:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:37Z Disabled control of system clock
I20260808 14:56:37.725155 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36477
--webserver_interface=127.12.73.190
--webserver_port=0
--builtin_ntp_servers=127.12.73.148:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:36477
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36323/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/testchainca.cert with env {}
W20260808 14:56:38.054265 21750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:38.054647 21750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:38.054766 21750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:38.061899 21750 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:38.062006 21750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:38.062045 21750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:38.062108 21750 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:38.062158 21750 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:56:38.062222 21750 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:56:38.062263 21750 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36323/jwks.json
I20260808 14:56:38.072109 21750 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:36477
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36323/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:38.073344 21750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:38.074564 21750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:38.086474 21761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:38.086450 21764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:38.087062 21770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:38.087239 21750 server_base.cc:1034] running on GCE node
I20260808 14:56:38.088038 21750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:38.089380 21750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:38.090613 21750 hybrid_clock.cc:648] HybridClock initialized: now 1786200998090546 us; error 45 us; skew 500 ppm
I20260808 14:56:38.090996 21750 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:56:38.099254 21750 webserver.cc:460] Webserver started at http://127.12.73.190:35047/ using document root <none> and password file <none>
I20260808 14:56:38.099936 21750 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:38.100031 21750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:38.100324 21750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:38.103204 21750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "6400a3fa04234428bee2c740510c1810"
format_stamp: "Formatted at 2026-08-08 14:56:38 on dist-test-slave-z8x9"
server_key: "74c017c03644c659bd6f7ffbfdb9780c"
server_key_iv: "632d514bef54bb2dc03ca5a74c476c5a"
server_key_version: "encryptionkey@0"
I20260808 14:56:38.103945 21750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "6400a3fa04234428bee2c740510c1810"
format_stamp: "Formatted at 2026-08-08 14:56:38 on dist-test-slave-z8x9"
server_key: "74c017c03644c659bd6f7ffbfdb9780c"
server_key_iv: "632d514bef54bb2dc03ca5a74c476c5a"
server_key_version: "encryptionkey@0"
I20260808 14:56:38.108997 21750 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:56:38.113126 21780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:38.114545 21750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:38.114763 21750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "6400a3fa04234428bee2c740510c1810"
format_stamp: "Formatted at 2026-08-08 14:56:38 on dist-test-slave-z8x9"
server_key: "74c017c03644c659bd6f7ffbfdb9780c"
server_key_iv: "632d514bef54bb2dc03ca5a74c476c5a"
server_key_version: "encryptionkey@0"
I20260808 14:56:38.114991 21750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:38.132746 21750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:38.133618 21750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:38.133935 21750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:38.152454 21750 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:36477
I20260808 14:56:38.152472 21868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:36477 every 8 connection(s)
I20260808 14:56:38.153872 21750 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:38.156543 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 21750
I20260808 14:56:38.156744 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:38.157655 12582 external_mini_cluster.cc:1428] Setting key 5eea3dea1c6eec73974555d1d7935226
I20260808 14:56:38.158073 21870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:38.171777 21870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810: Bootstrap starting.
I20260808 14:56:38.172093 21874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:38.159605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58400 (local address 127.12.73.190:36477)
0808 14:56:38.160618 (+ 1013us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:38.160636 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:38.160680 (+ 44us) server_negotiation.cc:407] Connection header received
0808 14:56:38.162779 (+ 2099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:38.162804 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:38.163273 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:38.163624 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:38.164202 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:38.165763 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:38.167532 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:38.168243 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:38.168388 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:38.169807 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:38.169814 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:38.169830 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:38.170350 (+ 520us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:38.170426 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:38.170447 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:38.170546 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:38.170781 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 14:56:38.171107 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":402,"threads_started":1}
I20260808 14:56:38.175060 21870 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:38.175858 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:56:38.176223 21870 log.cc:824] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:38.179250 21870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810: No bootstrap required, opened a new log
I20260808 14:56:38.186203 21870 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6400a3fa04234428bee2c740510c1810" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36477 } }
I20260808 14:56:38.186565 21870 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:38.186691 21870 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6400a3fa04234428bee2c740510c1810, State: Initialized, Role: FOLLOWER
I20260808 14:56:38.187237 21870 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6400a3fa04234428bee2c740510c1810" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36477 } }
I20260808 14:56:38.187438 21870 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:38.187616 21870 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:38.187774 21870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:38.189967 21870 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6400a3fa04234428bee2c740510c1810" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36477 } }
I20260808 14:56:38.190464 21870 leader_election.cc:302] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6400a3fa04234428bee2c740510c1810; no voters:
I20260808 14:56:38.191092 21870 leader_election.cc:288] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:38.191195 21876 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:38.191958 21876 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [term 1 LEADER]: Becoming Leader. State: Replica: 6400a3fa04234428bee2c740510c1810, State: Running, Role: LEADER
I20260808 14:56:38.192497 21876 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6400a3fa04234428bee2c740510c1810" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36477 } }
I20260808 14:56:38.193251 21870 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:38.195428 21880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6400a3fa04234428bee2c740510c1810. Latest consensus state: current_term: 1 leader_uuid: "6400a3fa04234428bee2c740510c1810" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6400a3fa04234428bee2c740510c1810" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36477 } } }
I20260808 14:56:38.195402 21877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6400a3fa04234428bee2c740510c1810" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6400a3fa04234428bee2c740510c1810" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36477 } } }
I20260808 14:56:38.195863 21880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:38.195863 21877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:38.197314 21887 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:38.202775 21887 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:38.212316 21887 catalog_manager.cc:1347] Generated new cluster ID: 2275584749174901b4e33e1fd9a179f7
I20260808 14:56:38.212445 21887 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:38.224514 21887 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:38.225847 21887 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:38.237422 21887 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6400a3fa04234428bee2c740510c1810: Generated new TSK 0
I20260808 14:56:38.238481 21887 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 14:56:38.271292 21918 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 14:56:38.271427 21918 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260808 14:56:38.272751 21917 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:56:38.252593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36477 (local address 127.0.0.1:58416)
0808 14:56:38.253273 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:38.253289 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:38.253419 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:38.253908 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:38.253912 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:38.253921 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:56:38.254162 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:38.254170 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:38.255619 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:38.255623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:38.256677 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:38.256687 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:38.257716 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:38.257720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:38.257868 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:38.257898 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:56:38.272211 (+ 14313us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36323/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 14:56:38.272426 (+ 215us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.73.190:36477: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36323/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":338,"threads_started":1}
I20260808 14:56:38.272744 21874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:38.252735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58416 (local address 127.12.73.190:36477)
0808 14:56:38.252921 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:38.252928 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:38.253375 (+ 447us) server_negotiation.cc:407] Connection header received
0808 14:56:38.253599 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:38.253605 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:38.253707 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:38.253888 (+ 181us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:56:38.254326 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:38.255486 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:38.256823 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:38.257547 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:38.257674 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:38.258194 (+ 520us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:56:38.271964 (+ 13770us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36323/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 14:56:38.272381 (+ 417us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58416: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36323/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 14:56:38.272893 21874 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58416: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36323/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260808 14:56:38.273976 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 21750
I20260808 14:56:38.275233 21862 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:38.367638 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 21750
2026-08-08T14:56:38Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (742 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 14:56:38.431407 12582 mini_oidc.cc:152] Starting JWKS server
I20260808 14:56:38.433418 12582 webserver.cc:460] Webserver started at https://127.0.0.1:37027/ using document root <none> and password file <none>
I20260808 14:56:38.433712 12582 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:56:38.434396 12582 webserver.cc:460] Webserver started at http://127.0.0.1:46165/ using document root <none> and password file <none>
2026-08-08T14:56:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:38Z Disabled control of system clock
I20260808 14:56:38.468147 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:35679
--webserver_interface=127.12.73.190
--webserver_port=0
--builtin_ntp_servers=127.12.73.148:45319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:35679
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37027/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 14:56:38.794322 21926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:38.794682 21926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:38.794858 21926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:38.801980 21926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:38.802137 21926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:38.802227 21926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:38.802331 21926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:38.802416 21926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:56:38.802508 21926 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:56:38.802585 21926 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37027/jwks.json
I20260808 14:56:38.811511 21926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:35679
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:35679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37027/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:38.813104 21926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:38.815290 21926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:38.827395 21936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:38.827454 21938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:38.827687 21935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:38.828245 21926 server_base.cc:1034] running on GCE node
I20260808 14:56:38.829082 21926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:38.830564 21926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:38.831807 21926 hybrid_clock.cc:648] HybridClock initialized: now 1786200998831753 us; error 47 us; skew 500 ppm
I20260808 14:56:38.832175 21926 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:56:38.834694 21926 webserver.cc:460] Webserver started at http://127.12.73.190:36023/ using document root <none> and password file <none>
I20260808 14:56:38.835392 21926 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:38.835526 21926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:38.835884 21926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:38.838945 21926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "1d4fa1b63984461f8768402032e8576f"
format_stamp: "Formatted at 2026-08-08 14:56:38 on dist-test-slave-z8x9"
server_key: "92e8c0c40eb6e8f35e7696a5b79d6902"
server_key_iv: "8d01ab676092075a83b6a48b9e135c12"
server_key_version: "encryptionkey@0"
I20260808 14:56:38.839823 21926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "1d4fa1b63984461f8768402032e8576f"
format_stamp: "Formatted at 2026-08-08 14:56:38 on dist-test-slave-z8x9"
server_key: "92e8c0c40eb6e8f35e7696a5b79d6902"
server_key_iv: "8d01ab676092075a83b6a48b9e135c12"
server_key_version: "encryptionkey@0"
I20260808 14:56:38.844950 21926 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 14:56:38.848553 21952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:38.850220 21926 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:38.850406 21926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "1d4fa1b63984461f8768402032e8576f"
format_stamp: "Formatted at 2026-08-08 14:56:38 on dist-test-slave-z8x9"
server_key: "92e8c0c40eb6e8f35e7696a5b79d6902"
server_key_iv: "8d01ab676092075a83b6a48b9e135c12"
server_key_version: "encryptionkey@0"
I20260808 14:56:38.850643 21926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:38.903060 21926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:38.903980 21926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:38.904320 21926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:38.923092 21926 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:35679
I20260808 14:56:38.923125 22041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:35679 every 8 connection(s)
I20260808 14:56:38.924468 21926 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:38.928136 22042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:38.929454 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 21926
I20260808 14:56:38.929678 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:38.930339 12582 external_mini_cluster.cc:1428] Setting key b8c2eaee249cc2d9745cbc8f9db74328
I20260808 14:56:38.940631 22042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f: Bootstrap starting.
I20260808 14:56:38.943852 22046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:38.932146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47736 (local address 127.12.73.190:35679)
0808 14:56:38.933121 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:38.933142 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:38.933240 (+ 98us) server_negotiation.cc:407] Connection header received
0808 14:56:38.934804 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:38.934828 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:38.935323 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:38.935684 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:38.936214 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:38.937553 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:38.939008 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:38.939669 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:38.939865 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:38.941209 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:38.941220 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:38.941243 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:38.942098 (+ 855us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:38.942237 (+ 139us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:38.942265 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:38.942423 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:38.942650 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 14:56:38.942950 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":378,"threads_started":1}
I20260808 14:56:38.943944 22042 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:38.945259 22042 log.cc:824] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:38.947690 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:56:38.948041 22042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f: No bootstrap required, opened a new log
I20260808 14:56:38.955161 22042 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4fa1b63984461f8768402032e8576f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 35679 } }
I20260808 14:56:38.955524 22042 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:38.955629 22042 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d4fa1b63984461f8768402032e8576f, State: Initialized, Role: FOLLOWER
I20260808 14:56:38.956216 22042 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4fa1b63984461f8768402032e8576f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 35679 } }
I20260808 14:56:38.956422 22042 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:38.956590 22042 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:38.956777 22042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:38.958976 22042 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4fa1b63984461f8768402032e8576f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 35679 } }
I20260808 14:56:38.959468 22042 leader_election.cc:302] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d4fa1b63984461f8768402032e8576f; no voters:
I20260808 14:56:38.960029 22042 leader_election.cc:288] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:38.960162 22051 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:38.960884 22051 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [term 1 LEADER]: Becoming Leader. State: Replica: 1d4fa1b63984461f8768402032e8576f, State: Running, Role: LEADER
I20260808 14:56:38.961501 22051 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4fa1b63984461f8768402032e8576f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 35679 } }
I20260808 14:56:38.962145 22042 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:38.964543 22055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d4fa1b63984461f8768402032e8576f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4fa1b63984461f8768402032e8576f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 35679 } } }
I20260808 14:56:38.965090 22055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:38.964800 22056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d4fa1b63984461f8768402032e8576f. Latest consensus state: current_term: 1 leader_uuid: "1d4fa1b63984461f8768402032e8576f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4fa1b63984461f8768402032e8576f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 35679 } } }
I20260808 14:56:38.965389 22056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:38.967391 22068 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:38.972064 22068 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:38.980505 22068 catalog_manager.cc:1347] Generated new cluster ID: 2cc658506b944280a8ba2c5c60a08815
I20260808 14:56:38.980631 22068 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:38.992600 22068 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:38.994113 22068 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:39.012079 22068 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d4fa1b63984461f8768402032e8576f: Generated new TSK 0
I20260808 14:56:39.013195 22068 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:56:39.034291 22046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:39.025899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47740 (local address 127.12.73.190:35679)
0808 14:56:39.026087 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:39.026094 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:39.026549 (+ 455us) server_negotiation.cc:407] Connection header received
0808 14:56:39.026745 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:39.026757 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:39.026854 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:39.027019 (+ 165us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:56:39.027478 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:39.028619 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:39.030023 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:39.030700 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:39.030827 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:39.031322 (+ 495us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:56:39.033657 (+ 2335us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37027/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 14:56:39.033992 (+ 335us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47740: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37027/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 14:56:39.034413 22046 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47740: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37027/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 14:56:39.036124 22095 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:56:39.025752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:35679 (local address 127.0.0.1:47740)
0808 14:56:39.026442 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:39.026463 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:39.026579 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:39.027041 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:39.027044 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:39.027054 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:56:39.027333 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:39.027342 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:39.028772 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:39.028776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:39.029883 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:39.029894 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:39.030885 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:39.030889 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:39.031017 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:39.031046 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:56:39.033860 (+ 2814us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37027/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 14:56:39.035694 (+ 1834us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.73.190:35679: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37027/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":557,"mutex_wait_us":1550,"thread_start_us":418,"threads_started":1}
I20260808 14:56:39.037151 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 21926
I20260808 14:56:39.038556 22037 generic_service.cc:196] Checking for leaks (request via RPC)
E20260808 14:56:39.047843 22097 webserver.cc:533] Webserver: sslize failed:
E20260808 14:56:39.047930 22097 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:56:39.132683 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 21926
2026-08-08T14:56:39Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (764 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T14:56:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:39Z Disabled control of system clock
I20260808 14:56:39.228909 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:42315
--webserver_interface=127.12.73.190
--webserver_port=0
--builtin_ntp_servers=127.12.73.148:35387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:42315
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/testchainca.cert with env {}
W20260808 14:56:39.551599 22103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:39.551900 22103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:39.551990 22103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:39.559192 22103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:39.559294 22103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:39.559333 22103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:39.559394 22103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:39.559440 22103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:56:39.559500 22103 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:56:39.559541 22103 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 14:56:39.569255 22103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:42315
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:42315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:39.570461 22103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:39.571720 22103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:39.583703 22110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:39.583766 22116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:39.583736 22111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:39.584561 22103 server_base.cc:1034] running on GCE node
I20260808 14:56:39.585377 22103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:39.586650 22103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:39.587852 22103 hybrid_clock.cc:648] HybridClock initialized: now 1786200999587806 us; error 31 us; skew 500 ppm
I20260808 14:56:39.588194 22103 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:56:39.590480 22103 webserver.cc:460] Webserver started at http://127.12.73.190:42561/ using document root <none> and password file <none>
I20260808 14:56:39.591173 22103 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:39.591289 22103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:39.591622 22103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:39.594538 22103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "af57d4f17d404411b1397001fd968529"
format_stamp: "Formatted at 2026-08-08 14:56:39 on dist-test-slave-z8x9"
server_key: "fa11d27440fce86cac030fe9fccce83b"
server_key_iv: "76ce131f4192c5fc1729850f03a9fbff"
server_key_version: "encryptionkey@0"
I20260808 14:56:39.595350 22103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "af57d4f17d404411b1397001fd968529"
format_stamp: "Formatted at 2026-08-08 14:56:39 on dist-test-slave-z8x9"
server_key: "fa11d27440fce86cac030fe9fccce83b"
server_key_iv: "76ce131f4192c5fc1729850f03a9fbff"
server_key_version: "encryptionkey@0"
I20260808 14:56:39.600481 22103 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:56:39.603714 22127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:39.604966 22103 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:56:39.605244 22103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "af57d4f17d404411b1397001fd968529"
format_stamp: "Formatted at 2026-08-08 14:56:39 on dist-test-slave-z8x9"
server_key: "fa11d27440fce86cac030fe9fccce83b"
server_key_iv: "76ce131f4192c5fc1729850f03a9fbff"
server_key_version: "encryptionkey@0"
I20260808 14:56:39.605474 22103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:39.627066 22103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:39.628247 22103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:39.628579 22103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:39.647428 22103 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:42315
I20260808 14:56:39.647446 22211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:42315 every 8 connection(s)
I20260808 14:56:39.648789 22103 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:39.652520 22212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:39.658618 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 22103
I20260808 14:56:39.658804 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:39.659453 12582 external_mini_cluster.cc:1428] Setting key d03bf85e6ad6c246862925c3d6e6c211
I20260808 14:56:39.664372 22212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529: Bootstrap starting.
I20260808 14:56:39.668289 22212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:39.669392 22212 log.cc:824] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:39.672552 22212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529: No bootstrap required, opened a new log
I20260808 14:56:39.674672 22218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:39.661439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57306 (local address 127.12.73.190:42315)
0808 14:56:39.662557 (+ 1118us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:39.662570 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:39.662617 (+ 47us) server_negotiation.cc:407] Connection header received
0808 14:56:39.664911 (+ 2294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:39.664939 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:39.665504 (+ 565us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:39.665933 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:39.666492 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:39.668474 (+ 1982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:39.669822 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:39.670663 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:39.670833 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:39.671909 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:39.671921 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:39.671937 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:56:39.672598 (+ 661us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:39.672702 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:56:39.672726 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:39.672838 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:39.673058 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 14:56:39.673433 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":357,"threads_started":1}
I20260808 14:56:39.678611 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:56:39.681659 22212 raft_consensus.cc:348] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af57d4f17d404411b1397001fd968529" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42315 } }
I20260808 14:56:39.682057 22212 raft_consensus.cc:374] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:39.682180 22212 raft_consensus.cc:729] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af57d4f17d404411b1397001fd968529, State: Initialized, Role: FOLLOWER
I20260808 14:56:39.682951 22212 consensus_queue.cc:260] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af57d4f17d404411b1397001fd968529" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42315 } }
I20260808 14:56:39.683229 22225 raft_consensus.cc:482] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:39.683490 22225 raft_consensus.cc:504] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af57d4f17d404411b1397001fd968529" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42315 } }
I20260808 14:56:39.684002 22212 raft_consensus.cc:388] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:39.684202 22212 raft_consensus.cc:482] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:39.684051 22225 leader_election.cc:302] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af57d4f17d404411b1397001fd968529; no voters:
I20260808 14:56:39.684326 22212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:39.684896 22225 leader_election.cc:288] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260808 14:56:39.687013 22212 raft_consensus.cc:504] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af57d4f17d404411b1397001fd968529" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42315 } }
I20260808 14:56:39.687273 22212 leader_election.cc:302] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af57d4f17d404411b1397001fd968529; no voters:
I20260808 14:56:39.687316 22227 raft_consensus.cc:2741] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260808 14:56:39.687505 22212 leader_election.cc:288] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:39.687983 22225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:39.688653 22225 raft_consensus.cc:686] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [term 1 LEADER]: Becoming Leader. State: Replica: af57d4f17d404411b1397001fd968529, State: Running, Role: LEADER
I20260808 14:56:39.689246 22225 consensus_queue.cc:237] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af57d4f17d404411b1397001fd968529" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42315 } }
I20260808 14:56:39.689895 22212 sys_catalog.cc:564] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:39.691534 22228 sys_catalog.cc:455] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af57d4f17d404411b1397001fd968529" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af57d4f17d404411b1397001fd968529" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42315 } } }
I20260808 14:56:39.692013 22228 sys_catalog.cc:458] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:39.692754 22227 sys_catalog.cc:455] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af57d4f17d404411b1397001fd968529. Latest consensus state: current_term: 1 leader_uuid: "af57d4f17d404411b1397001fd968529" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af57d4f17d404411b1397001fd968529" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42315 } } }
I20260808 14:56:39.692994 22236 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:39.693089 22227 sys_catalog.cc:458] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:39.699704 22236 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:39.709074 22236 catalog_manager.cc:1347] Generated new cluster ID: da7735cc83d649979cac01c31602c7c7
I20260808 14:56:39.709232 22236 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:39.724694 22236 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:39.726014 22236 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:39.736433 22236 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af57d4f17d404411b1397001fd968529: Generated new TSK 0
I20260808 14:56:39.737418 22236 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:56:40.181748 22218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:39.762358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57310 (local address 127.12.73.190:42315)
0808 14:56:39.762544 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:39.762550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:39.763054 (+ 504us) server_negotiation.cc:407] Connection header received
0808 14:56:39.763255 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:39.763261 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:39.763366 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:39.763529 (+ 163us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:56:39.763939 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:39.765121 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:39.766509 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:39.767171 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:39.767288 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:39.767770 (+ 482us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:56:40.181146 (+413376us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 14:56:40.181509 (+ 363us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57310: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 14:56:40.181872 22218 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57310: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 14:56:40.182160 22262 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:56:39.762343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:42315 (local address 127.0.0.1:57310)
0808 14:56:39.762953 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:39.762969 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:39.763085 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:39.763550 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:39.763554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:39.763563 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:56:39.763797 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:39.763804 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:39.765293 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:39.765297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:39.766360 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:39.766370 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:39.767346 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:39.767350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:39.767485 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:39.767514 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:56:40.181470 (+413956us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 14:56:40.181714 (+ 244us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.73.190:42315: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":326,"threads_started":1}
I20260808 14:56:40.183487 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 22103
I20260808 14:56:40.184659 22205 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:40.287922 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 22103
2026-08-08T14:56:40Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1138 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (418 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (434 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:56:41 dist-test-slave-z8x9 krb5kdc[22286](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:56:41 dist-test-slave-z8x9 krb5kdc[22286](info): set up 2 sockets
Aug 08 14:56:41 dist-test-slave-z8x9 krb5kdc[22286](info): commencing operation
krb5kdc: starting...
W20260808 14:56:42.472134 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.008s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:56:42 dist-test-slave-z8x9 krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:56:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:56:42.712842 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:43205
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:45881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:43205
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:43.037533 22308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:43.037803 22308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:43.037894 22308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:43.044783 22308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:43.044886 22308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:43.044932 22308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:43.045009 22308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:43.045058 22308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:43.054595 22308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:43205
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:43205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:43.055900 22308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:43.057147 22308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:43.069402 22321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:43.069535 22318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:43.069489 22316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:43.070365 22308 server_base.cc:1034] running on GCE node
I20260808 14:56:43.071172 22308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:43.072638 22308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:43.073895 22308 hybrid_clock.cc:648] HybridClock initialized: now 1786201003073833 us; error 58 us; skew 500 ppm
I20260808 14:56:43.074261 22308 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:43 dist-test-slave-z8x9 krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201003, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:43.077489 22308 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:56:43.078985 22308 webserver.cc:460] Webserver started at http://127.12.73.190:34601/ using document root <none> and password file <none>
I20260808 14:56:43.079607 22308 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:43.079710 22308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:43.080111 22308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:43.083168 22308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "e60779d898bc4107bda808ef41558571"
format_stamp: "Formatted at 2026-08-08 14:56:43 on dist-test-slave-z8x9"
server_key: "c2b08c92092a63fcbaca68952c8e7517"
server_key_iv: "01c63812f5ae31b3e9ad95a633907866"
server_key_version: "encryptionkey@0"
I20260808 14:56:43.083900 22308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "e60779d898bc4107bda808ef41558571"
format_stamp: "Formatted at 2026-08-08 14:56:43 on dist-test-slave-z8x9"
server_key: "c2b08c92092a63fcbaca68952c8e7517"
server_key_iv: "01c63812f5ae31b3e9ad95a633907866"
server_key_version: "encryptionkey@0"
I20260808 14:56:43.089104 22308 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 14:56:43.092669 22333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:43.094019 22308 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:43.094214 22308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "e60779d898bc4107bda808ef41558571"
format_stamp: "Formatted at 2026-08-08 14:56:43 on dist-test-slave-z8x9"
server_key: "c2b08c92092a63fcbaca68952c8e7517"
server_key_iv: "01c63812f5ae31b3e9ad95a633907866"
server_key_version: "encryptionkey@0"
I20260808 14:56:43.094437 22308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:43.130999 22308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:43.135345 22308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:43.135641 22308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:43.154744 22308 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:43205
I20260808 14:56:43.154831 22417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:43205 every 8 connection(s)
I20260808 14:56:43.156176 22308 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:43.160408 22418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:43.166078 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 22308
I20260808 14:56:43.166306 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:43.166967 12582 external_mini_cluster.cc:1428] Setting key e89aa6b8230049d690e042bf06a45f3d
I20260808 14:56:43.171176 22418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571: Bootstrap starting.
I20260808 14:56:43.174911 22418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:43.176105 22418 log.cc:824] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:43.179248 22418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571: No bootstrap required, opened a new log
Aug 08 14:56:43 dist-test-slave-z8x9 krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:43.190112 22418 raft_consensus.cc:348] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e60779d898bc4107bda808ef41558571" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43205 } }
I20260808 14:56:43.190582 22418 raft_consensus.cc:374] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:43.190707 22418 raft_consensus.cc:729] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e60779d898bc4107bda808ef41558571, State: Initialized, Role: FOLLOWER
I20260808 14:56:43.191402 22418 consensus_queue.cc:260] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e60779d898bc4107bda808ef41558571" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43205 } }
I20260808 14:56:43.191735 22418 raft_consensus.cc:388] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:43.191771 22422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:43.168922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36030 (local address 127.12.73.190:43205)
0808 14:56:43.169773 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:43.169783 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:43.169823 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:56:43.171578 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:43.171601 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:43.171962 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:43.172258 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:43.174157 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:43.175496 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:43.177220 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:43.177941 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:43.178066 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:43.182836 (+ 4770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:43.182846 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:43.182864 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:43.182907 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:43.187104 (+ 4197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:43.187851 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:43.187859 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:43.187867 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:43.188093 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:43.188460 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:43.188466 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:43.188471 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:43.189226 (+ 755us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:43.189501 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:43.189893 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 14:56:43.190310 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":437,"threads_started":1}
I20260808 14:56:43.191902 22418 raft_consensus.cc:482] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:43.192147 22418 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:43.194562 22418 raft_consensus.cc:504] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e60779d898bc4107bda808ef41558571" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43205 } }
I20260808 14:56:43.195041 22418 leader_election.cc:302] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e60779d898bc4107bda808ef41558571; no voters:
I20260808 14:56:43.195614 22418 leader_election.cc:288] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:43.195760 22425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:43.196480 22425 raft_consensus.cc:686] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [term 1 LEADER]: Becoming Leader. State: Replica: e60779d898bc4107bda808ef41558571, State: Running, Role: LEADER
I20260808 14:56:43.197082 22425 consensus_queue.cc:237] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e60779d898bc4107bda808ef41558571" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43205 } }
I20260808 14:56:43.197777 22418 sys_catalog.cc:564] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:43.201212 22426 sys_catalog.cc:455] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e60779d898bc4107bda808ef41558571" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e60779d898bc4107bda808ef41558571" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43205 } } }
I20260808 14:56:43.201687 22426 sys_catalog.cc:458] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:43.202116 22427 sys_catalog.cc:455] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e60779d898bc4107bda808ef41558571. Latest consensus state: current_term: 1 leader_uuid: "e60779d898bc4107bda808ef41558571" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e60779d898bc4107bda808ef41558571" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43205 } } }
I20260808 14:56:43.202524 22427 sys_catalog.cc:458] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:43.206199 22446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:43.211107 22446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:43.221055 22446 catalog_manager.cc:1347] Generated new cluster ID: 316cc808f7774f5c825fa0b08fc5350a
I20260808 14:56:43.221201 22446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:43.235535 22446 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:43.237154 22446 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:43.244911 22446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e60779d898bc4107bda808ef41558571: Generated new TSK 0
I20260808 14:56:43.245831 22446 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:56:43.314733 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43205
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:45881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:43.647534 22462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:43.647815 22462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:43.647990 22462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:43.655390 22462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:43.655519 22462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:43.655697 22462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:56:43.665526 22462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43205
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:43.666741 22462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:43.668062 22462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:43.681129 22473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:43.681213 22469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:43.681252 22470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:43.682024 22462 server_base.cc:1034] running on GCE node
I20260808 14:56:43.682621 22462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:43.683533 22462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:43.684767 22462 hybrid_clock.cc:648] HybridClock initialized: now 1786201003684719 us; error 61 us; skew 500 ppm
I20260808 14:56:43.685071 22462 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:43 dist-test-slave-z8x9 krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201003, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:43.688355 22462 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:56:43.689770 22462 webserver.cc:460] Webserver started at http://127.12.73.129:44771/ using document root <none> and password file <none>
I20260808 14:56:43.690562 22462 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:43.690704 22462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:43.690966 22462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:43.693761 22462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "7496f9ce21a94614a1251aca1d6167c5"
format_stamp: "Formatted at 2026-08-08 14:56:43 on dist-test-slave-z8x9"
server_key: "7464c98a9d09ea20359c77627ca1cf47"
server_key_iv: "c47bc1dbec82bc00ad8fa2f5b62c98eb"
server_key_version: "encryptionkey@0"
I20260808 14:56:43.694485 22462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "7496f9ce21a94614a1251aca1d6167c5"
format_stamp: "Formatted at 2026-08-08 14:56:43 on dist-test-slave-z8x9"
server_key: "7464c98a9d09ea20359c77627ca1cf47"
server_key_iv: "c47bc1dbec82bc00ad8fa2f5b62c98eb"
server_key_version: "encryptionkey@0"
I20260808 14:56:43.699728 22462 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:56:43.702997 22486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:43.704231 22462 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260808 14:56:43.704397 22462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "7496f9ce21a94614a1251aca1d6167c5"
format_stamp: "Formatted at 2026-08-08 14:56:43 on dist-test-slave-z8x9"
server_key: "7464c98a9d09ea20359c77627ca1cf47"
server_key_iv: "c47bc1dbec82bc00ad8fa2f5b62c98eb"
server_key_version: "encryptionkey@0"
I20260808 14:56:43.704602 22462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:43.727600 22462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:43.731600 22462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:43.731914 22462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:43.732906 22462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:43.734292 22462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:43.734367 22462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:43.734541 22462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:43.734596 22462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:43.769100 22462 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:46825
I20260808 14:56:43.769224 22666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:46825 every 8 connection(s)
I20260808 14:56:43.770455 22462 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:56:43.779129 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 22462
I20260808 14:56:43.779345 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:56:43.780000 12582 external_mini_cluster.cc:1428] Setting key 5e4ee3a0b723c00a1fb65d48568be56d
Aug 08 14:56:43 dist-test-slave-z8x9 krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201003, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:43.791162 22669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:43.772997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:36989 (local address 127.12.73.190:43205)
0808 14:56:43.773482 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:43.773487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:43.774392 (+ 905us) server_negotiation.cc:407] Connection header received
0808 14:56:43.776182 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:43.776187 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:43.776304 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:43.776458 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:43.778022 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:43.778736 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:43.780428 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:43.780954 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:43.781088 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:43.785369 (+ 4281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:43.785374 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:43.785377 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:43.785410 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:43.787995 (+ 2585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:43.788747 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:43.788753 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:43.788756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:43.788887 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:43.789399 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:43.789404 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:43.789407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:43.789687 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:43.789847 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:43.790560 (+ 713us) server_negotiation.cc:299] Negotiation successful
0808 14:56:43.790796 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":267,"threads_started":1}
I20260808 14:56:43.792172 22670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:43.773504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:43205 (local address 127.12.73.129:36989)
0808 14:56:43.774232 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:43.774277 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:43.775917 (+ 1640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:43.776694 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:43.776709 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:43.777295 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:43.777853 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:43.777870 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:43.778899 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:43.778909 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:43.780268 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:43.780280 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:43.781200 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:43.781209 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:43.781450 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:43.782142 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:43.782163 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:43.785090 (+ 2927us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:43.788163 (+ 3073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:43.788174 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:43.788189 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:43.788609 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:43.788998 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:43.789003 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:43.789007 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:43.789274 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:43.789830 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:43.789838 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:43.790192 (+ 354us) client_negotiation.cc:769] Sending connection context
0808 14:56:43.790450 (+ 258us) client_negotiation.cc:240] Negotiation successful
0808 14:56:43.790963 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":295,"threads_started":1}
I20260808 14:56:43.793720 22667 heartbeater.cc:347] Connected to a master server at 127.12.73.190:43205
I20260808 14:56:43.794031 22667 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:43.794742 22667 heartbeater.cc:511] Master 127.12.73.190:43205 requested a full tablet report, sending...
I20260808 14:56:43.796819 22360 ts_manager.cc:194] Registered new tserver with Master: 7496f9ce21a94614a1251aca1d6167c5 (127.12.73.129:46825)
I20260808 14:56:43.798662 22360 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:36989
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:56:43.836359 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43205
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:45881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:44.168305 22680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:44.168543 22680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:44.168701 22680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:44.175670 22680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:44.175771 22680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:44.175972 22680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:56:44.185371 22680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43205
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:44.186559 22680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:44.187840 22680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:44.200654 22685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:44.200600 22686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:44.201061 22688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:44.202098 22680 server_base.cc:1034] running on GCE node
I20260808 14:56:44.202782 22680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:44.203696 22680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:44.204941 22680 hybrid_clock.cc:648] HybridClock initialized: now 1786201004204897 us; error 54 us; skew 500 ppm
I20260808 14:56:44.205343 22680 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:44.208922 22680 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:56:44.210362 22680 webserver.cc:460] Webserver started at http://127.12.73.130:43987/ using document root <none> and password file <none>
I20260808 14:56:44.211051 22680 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:44.211185 22680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:44.211503 22680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:44.214524 22680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "4515ce4aa63645d4816858b1b6304f3e"
format_stamp: "Formatted at 2026-08-08 14:56:44 on dist-test-slave-z8x9"
server_key: "7f2ce0d54ddd8ee77a4ab980271eff9d"
server_key_iv: "7509818fbbf0c4245ee9513eef89ece0"
server_key_version: "encryptionkey@0"
I20260808 14:56:44.215355 22680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "4515ce4aa63645d4816858b1b6304f3e"
format_stamp: "Formatted at 2026-08-08 14:56:44 on dist-test-slave-z8x9"
server_key: "7f2ce0d54ddd8ee77a4ab980271eff9d"
server_key_iv: "7509818fbbf0c4245ee9513eef89ece0"
server_key_version: "encryptionkey@0"
I20260808 14:56:44.220701 22680 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 14:56:44.224334 22703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:44.225657 22680 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:44.225840 22680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "4515ce4aa63645d4816858b1b6304f3e"
format_stamp: "Formatted at 2026-08-08 14:56:44 on dist-test-slave-z8x9"
server_key: "7f2ce0d54ddd8ee77a4ab980271eff9d"
server_key_iv: "7509818fbbf0c4245ee9513eef89ece0"
server_key_version: "encryptionkey@0"
I20260808 14:56:44.226049 22680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:44.244937 22680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:44.249344 22680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:44.249634 22680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:44.250557 22680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:44.251878 22680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:44.251953 22680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:44.252043 22680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:44.252089 22680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:44.285530 22680 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:41847
I20260808 14:56:44.285569 22881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:41847 every 8 connection(s)
I20260808 14:56:44.286823 22680 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:56:44.289093 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 22680
I20260808 14:56:44.289297 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:56:44.289862 12582 external_mini_cluster.cc:1428] Setting key 5506caff67f7a4cd506093aa0d34d5b7
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:44.311147 22669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:44.289520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:55661 (local address 127.12.73.190:43205)
0808 14:56:44.289763 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:44.289769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:44.291137 (+ 1368us) server_negotiation.cc:407] Connection header received
0808 14:56:44.293666 (+ 2529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:44.293670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:44.293737 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:44.293821 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:44.295863 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.296551 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.299042 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.299486 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.299590 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:44.303989 (+ 4399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:44.303998 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:44.304007 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:44.304052 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:44.307727 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:44.308502 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:44.308510 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:44.308516 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:44.308682 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:44.309229 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:44.309237 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:44.309243 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:44.309639 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:44.309828 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:44.310449 (+ 621us) server_negotiation.cc:299] Negotiation successful
0808 14:56:44.310717 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 14:56:44.311712 22885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:44.290109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:43205 (local address 127.12.73.130:55661)
0808 14:56:44.290992 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:44.291035 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:44.293377 (+ 2342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:44.294106 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:44.294120 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:44.294921 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:44.295688 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:44.295716 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.296706 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.296714 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:44.298893 (+ 2179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:44.298912 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.299723 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.299733 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:44.300063 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:44.300802 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:44.300844 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:44.303756 (+ 2912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:44.307889 (+ 4133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:44.307916 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:44.307933 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:44.308375 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:44.308828 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:44.308833 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:44.308847 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:44.309090 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:44.309777 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:44.309782 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:44.310090 (+ 308us) client_negotiation.cc:769] Sending connection context
0808 14:56:44.310303 (+ 213us) client_negotiation.cc:240] Negotiation successful
0808 14:56:44.310646 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":370,"threads_started":1}
I20260808 14:56:44.313102 22883 heartbeater.cc:347] Connected to a master server at 127.12.73.190:43205
I20260808 14:56:44.313441 22883 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:44.314165 22883 heartbeater.cc:511] Master 127.12.73.190:43205 requested a full tablet report, sending...
I20260808 14:56:44.315557 22360 ts_manager.cc:194] Registered new tserver with Master: 4515ce4aa63645d4816858b1b6304f3e (127.12.73.130:41847)
I20260808 14:56:44.316387 22360 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:55661
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:56:44.346570 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43205
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:45881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:44.682699 22890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:44.683012 22890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:44.683182 22890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:44.690320 22890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:44.690467 22890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:44.690639 22890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:56:44.700559 22890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43205
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:44.701942 22890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:44.703219 22890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:44.717577 22899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:44.717617 22905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:44.717669 22900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:44.718297 22890 server_base.cc:1034] running on GCE node
I20260808 14:56:44.718914 22890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:44.719842 22890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:44.721078 22890 hybrid_clock.cc:648] HybridClock initialized: now 1786201004721026 us; error 48 us; skew 500 ppm
I20260808 14:56:44.721406 22890 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:44.724637 22890 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:56:44.726344 22890 webserver.cc:460] Webserver started at http://127.12.73.131:46785/ using document root <none> and password file <none>
I20260808 14:56:44.727056 22890 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:44.727208 22890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:44.727523 22890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:44.730517 22890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "2585aeecaaf14edd94accc1bb33e3107"
format_stamp: "Formatted at 2026-08-08 14:56:44 on dist-test-slave-z8x9"
server_key: "df16d070ef54f7c8586fddec7337e61a"
server_key_iv: "22f234bbabcb08611e934f4de1c253a2"
server_key_version: "encryptionkey@0"
I20260808 14:56:44.731345 22890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "2585aeecaaf14edd94accc1bb33e3107"
format_stamp: "Formatted at 2026-08-08 14:56:44 on dist-test-slave-z8x9"
server_key: "df16d070ef54f7c8586fddec7337e61a"
server_key_iv: "22f234bbabcb08611e934f4de1c253a2"
server_key_version: "encryptionkey@0"
I20260808 14:56:44.736435 22890 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 14:56:44.739712 22917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:44.740885 22890 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:56:44.741058 22890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "2585aeecaaf14edd94accc1bb33e3107"
format_stamp: "Formatted at 2026-08-08 14:56:44 on dist-test-slave-z8x9"
server_key: "df16d070ef54f7c8586fddec7337e61a"
server_key_iv: "22f234bbabcb08611e934f4de1c253a2"
server_key_version: "encryptionkey@0"
I20260808 14:56:44.741334 22890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:44.766548 22890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:44.771720 22890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:44.772047 22890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:44.773216 22890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:44.774873 22890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:44.774966 22890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:44.775084 22890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:44.775144 22890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:44.802560 22667 heartbeater.cc:503] Master 127.12.73.190:43205 was elected leader, sending a full tablet report...
I20260808 14:56:44.808538 22890 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:45551
I20260808 14:56:44.808585 23101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:45551 every 8 connection(s)
I20260808 14:56:44.809947 22890 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:56:44.818555 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 22890
I20260808 14:56:44.818734 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:56:44.819267 12582 external_mini_cluster.cc:1428] Setting key f53cfa5ac57edde27245f7c6591dcc30
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:56:44.831120 23104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:44.812662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:35313 (local address 127.12.73.190:43205)
0808 14:56:44.813222 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:44.813228 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:44.814125 (+ 897us) server_negotiation.cc:407] Connection header received
0808 14:56:44.815976 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:44.815982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:44.816079 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:44.816201 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:44.817789 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.818921 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.820817 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.821424 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.821567 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:44.825089 (+ 3522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:44.825094 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:44.825097 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:44.825131 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:44.827825 (+ 2694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:44.828575 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:44.828582 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:44.828585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:44.828725 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:44.829203 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:44.829208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:44.829212 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:44.829536 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:44.829703 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:44.830457 (+ 754us) server_negotiation.cc:299] Negotiation successful
0808 14:56:44.830712 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":291,"threads_started":1}
I20260808 14:56:44.832106 23107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:44.813158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:43205 (local address 127.12.73.131:35313)
0808 14:56:44.813959 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:44.814001 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:44.815684 (+ 1683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:44.816449 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:44.816457 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:44.816984 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:44.817620 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:44.817637 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.819089 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.819094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:44.820662 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:44.820675 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.821656 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.821666 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:44.821911 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:44.822628 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:44.822651 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:44.824866 (+ 2215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:44.827973 (+ 3107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:44.827982 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:44.827999 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:44.828444 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:44.828853 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:44.828858 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:44.828862 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:44.829061 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:44.829685 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:44.829694 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:44.830077 (+ 383us) client_negotiation.cc:769] Sending connection context
0808 14:56:44.830357 (+ 280us) client_negotiation.cc:240] Negotiation successful
0808 14:56:44.830968 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":287,"threads_started":1}
I20260808 14:56:44.833588 23102 heartbeater.cc:347] Connected to a master server at 127.12.73.190:43205
I20260808 14:56:44.833956 23102 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:44.834704 23102 heartbeater.cc:511] Master 127.12.73.190:43205 requested a full tablet report, sending...
I20260808 14:56:44.836125 22360 ts_manager.cc:194] Registered new tserver with Master: 2585aeecaaf14edd94accc1bb33e3107 (127.12.73.131:45551)
I20260808 14:56:44.836938 22360 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:35313
I20260808 14:56:44.847327 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/test-admin.keytab.
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:44.879251 12582 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 14:56:44.884230 23114 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:56:44.881909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34780 (local address 127.12.73.129:46825)
0808 14:56:44.882526 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:44.882533 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:44.882560 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:56:44.882622 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:44.882628 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:44.882837 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:44.882967 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:44.883850 (+ 883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34780: BlockingRecv error: recv got EOF from 127.0.0.1:34780 (error 108)
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":319,"threads_started":1}
W20260808 14:56:44.884990 12582 init.cc:244] Error while opening credential cache '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/krb5cc)
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:44.886638 12582 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:44.888113 12582 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:56:44.903966 23114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:44.889767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34788 (local address 127.12.73.129:46825)
0808 14:56:44.889975 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:44.889983 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:44.890245 (+ 262us) server_negotiation.cc:407] Connection header received
0808 14:56:44.890432 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:44.890437 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:44.890506 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:44.890612 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:44.891658 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.892631 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.893976 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.894542 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.894685 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:44.898367 (+ 3682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:44.898378 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:44.898392 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:44.898428 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:44.901151 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:44.901949 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:44.901957 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:44.901959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:44.902083 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:44.902451 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:44.902456 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:44.902459 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:44.902811 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:44.903114 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:44.903436 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 14:56:44.903684 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260808 14:56:44.909785 23114 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:56:44.908132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34794 (local address 127.12.73.129:46825)
0808 14:56:44.908284 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:44.908287 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:44.908584 (+ 297us) server_negotiation.cc:407] Connection header received
0808 14:56:44.908709 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:44.908713 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:44.908762 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:44.908887 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:44.909514 (+ 627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34794: BlockingRecv error: recv got EOF from 127.0.0.1:34794 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 14:56:44.909960 12582 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:44.911662 12582 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:44.912986 12582 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:56:44.926112 23114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:44.914229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34798 (local address 127.12.73.129:46825)
0808 14:56:44.914442 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:44.914448 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:44.914641 (+ 193us) server_negotiation.cc:407] Connection header received
0808 14:56:44.914747 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:44.914751 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:44.914802 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:44.914877 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:44.915755 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.916449 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.917686 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.918101 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.918210 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:44.921471 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:44.921476 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:44.921479 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:44.921508 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:44.923900 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:44.924540 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:44.924544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:44.924546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:44.924656 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:44.924992 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:44.924995 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:44.924997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:44.925328 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:44.925531 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:44.925761 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 14:56:44.925905 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 14:56:44.930313 23114 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:56:44.928518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34806 (local address 127.12.73.129:46825)
0808 14:56:44.928746 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:44.928751 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:44.928966 (+ 215us) server_negotiation.cc:407] Connection header received
0808 14:56:44.929082 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:44.929085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:44.929150 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:44.929278 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:44.930076 (+ 798us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34806: BlockingRecv error: recv got EOF from 127.0.0.1:34806 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260808 14:56:44.930502 12582 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200952883082-12582-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:44.932014 12582 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:44.933373 12582 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:56:44 dist-test-slave-z8x9 krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:56:44.947448 23114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:44.934563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34814 (local address 127.12.73.129:46825)
0808 14:56:44.934766 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:44.934774 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:44.935031 (+ 257us) server_negotiation.cc:407] Connection header received
0808 14:56:44.935211 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:44.935215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:44.935267 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:44.935369 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:44.936304 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.937002 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.938283 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.938705 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.938845 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:44.942169 (+ 3324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:44.942173 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:44.942176 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:44.942206 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:44.944876 (+ 2670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:44.945561 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:44.945566 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:44.945570 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:44.945700 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:44.946096 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:44.946101 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:44.946104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:44.946395 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:44.946704 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:44.946956 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 14:56:44.947153 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:56:44.949072 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 22462
I20260808 14:56:44.960083 23114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:44.949766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34816 (local address 127.12.73.129:46825)
0808 14:56:44.949913 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:44.949916 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:44.950285 (+ 369us) server_negotiation.cc:407] Connection header received
0808 14:56:44.950394 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:44.950397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:44.950446 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:44.950520 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:44.951528 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.952167 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.953406 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:44.953819 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:44.953915 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:44.955688 (+ 1773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:44.955692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:44.955695 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:44.955722 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:44.958008 (+ 2286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:44.958561 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:44.958564 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:44.958567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:44.958696 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:44.959002 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:44.959005 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:44.959007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:44.959260 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:44.959446 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:44.959677 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 14:56:44.959832 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:56:44.960624 22658 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:45.043437 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 22462
I20260808 14:56:45.068365 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 22680
Aug 08 14:56:45 dist-test-slave-z8x9 krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:56:45.084218 23136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:45.069344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34960 (local address 127.12.73.130:41847)
0808 14:56:45.069917 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:45.069924 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:45.069949 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:56:45.070017 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:45.070023 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:45.070227 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:45.070412 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:45.071427 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:45.072436 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:45.073857 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:45.074434 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:45.074588 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:45.078470 (+ 3882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:45.078480 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:45.078495 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:45.078529 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:45.081385 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:45.082079 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:45.082087 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:45.082089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:45.082215 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:45.082623 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:45.082627 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:45.082629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:45.082964 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:45.083285 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:45.083635 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 14:56:45.083901 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":307,"threads_started":1}
I20260808 14:56:45.085554 22872 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:45.170433 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 22680
I20260808 14:56:45.192945 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 22890
Aug 08 14:56:45 dist-test-slave-z8x9 krb5kdc[22286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:56:45.208899 23138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:45.194004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57766 (local address 127.12.73.131:45551)
0808 14:56:45.194642 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:45.194649 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:45.194678 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:56:45.194743 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:45.194749 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:45.194955 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:45.195127 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:45.196217 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:45.197376 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:45.198911 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:45.199453 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:45.199557 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:45.203690 (+ 4133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:45.203702 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:45.203717 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:45.203748 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:45.206541 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:45.207171 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:45.207178 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:45.207180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:45.207289 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:45.207608 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:45.207611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:45.207613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:45.207923 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:45.208148 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:45.208392 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 14:56:45.208608 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":329,"threads_started":1}
I20260808 14:56:45.210283 23093 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:45.292963 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 22890
I20260808 14:56:45.317212 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 22308
I20260808 14:56:45.318454 22407 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:45.421916 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 22308
2026-08-08T14:56:45Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4279 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:56:45 dist-test-slave-z8x9 krb5kdc[23143](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:56:45 dist-test-slave-z8x9 krb5kdc[23143](info): set up 2 sockets
Aug 08 14:56:45 dist-test-slave-z8x9 krb5kdc[23143](info): commencing operation
krb5kdc: starting...
W20260808 14:56:46.748382 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.002s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:56:46 dist-test-slave-z8x9 krb5kdc[23143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:56:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:46Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.190.keytab.
Entry for principal oryx/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.190.keytab.
I20260808 14:56:46.994288 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33041
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.190.keytab
--principal=oryx/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:44131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:33041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:47.319245 23165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:47.319559 23165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:47.319721 23165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:47.326673 23165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:47.326808 23165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:47.326915 23165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:47.327014 23165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:47.327097 23165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:47.336975 23165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:44131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:33041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.190.keytab
--principal=oryx/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:47.338269 23165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:47.339524 23165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:47.351233 23183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:47.351197 23176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:47.351282 23177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:47.352293 23165 server_base.cc:1034] running on GCE node
I20260808 14:56:47.353062 23165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:47.354446 23165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:47.355683 23165 hybrid_clock.cc:648] HybridClock initialized: now 1786201007355649 us; error 53 us; skew 500 ppm
I20260808 14:56:47.356029 23165 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:47 dist-test-slave-z8x9 krb5kdc[23143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201007, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:47.359266 23165 init.cc:377] Logged in from keytab as oryx/127.12.73.190@KRBTEST.COM (short username oryx)
I20260808 14:56:47.360759 23165 webserver.cc:460] Webserver started at http://127.12.73.190:39937/ using document root <none> and password file <none>
I20260808 14:56:47.361524 23165 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:47.361675 23165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:47.361989 23165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:47.364845 23165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc"
format_stamp: "Formatted at 2026-08-08 14:56:47 on dist-test-slave-z8x9"
server_key: "76a19d4a486399b73db48eb749725c48"
server_key_iv: "5bc0d92640601726087a7997664da03a"
server_key_version: "encryptionkey@0"
I20260808 14:56:47.365624 23165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc"
format_stamp: "Formatted at 2026-08-08 14:56:47 on dist-test-slave-z8x9"
server_key: "76a19d4a486399b73db48eb749725c48"
server_key_iv: "5bc0d92640601726087a7997664da03a"
server_key_version: "encryptionkey@0"
I20260808 14:56:47.370576 23165 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 14:56:47.373903 23192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:47.375191 23165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:56:47.375380 23165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc"
format_stamp: "Formatted at 2026-08-08 14:56:47 on dist-test-slave-z8x9"
server_key: "76a19d4a486399b73db48eb749725c48"
server_key_iv: "5bc0d92640601726087a7997664da03a"
server_key_version: "encryptionkey@0"
I20260808 14:56:47.375578 23165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:47.389002 23165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:47.392912 23165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:47.393256 23165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:47.412097 23165 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:33041
I20260808 14:56:47.412153 23281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:33041 every 8 connection(s)
I20260808 14:56:47.413574 23165 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:47.417258 23283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:47.417989 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 23165
I20260808 14:56:47.418200 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:47.418861 12582 external_mini_cluster.cc:1428] Setting key 5c8bb7606249b39d179ea49d63587662
I20260808 14:56:47.431427 23283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc: Bootstrap starting.
Aug 08 14:56:47 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:56:47.434491 23283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:47.435881 23283 log.cc:824] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:47.438807 23283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc: No bootstrap required, opened a new log
I20260808 14:56:47.442780 23287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:47.420958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36308 (local address 127.12.73.190:33041)
0808 14:56:47.421838 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:47.421858 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:47.421909 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:56:47.423858 (+ 1949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:47.423886 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:47.424383 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:47.424813 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:47.426289 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:47.428319 (+ 2030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:47.429717 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:47.430735 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:47.430918 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:47.434894 (+ 3976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:47.434907 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:47.434926 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:47.434982 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:47.438489 (+ 3507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:47.439328 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:47.439334 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:47.439339 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:47.439520 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:47.439926 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:47.439929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:47.439931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:47.440435 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:47.440677 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:47.441290 (+ 613us) server_negotiation.cc:299] Negotiation successful
0808 14:56:47.441725 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":398,"threads_started":1}
I20260808 14:56:47.447674 23283 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } }
I20260808 14:56:47.448076 23283 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:47.448184 23283 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80fc452b6d8e4c0a8a7147a0dc426fdc, State: Initialized, Role: FOLLOWER
I20260808 14:56:47.448769 23283 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } }
I20260808 14:56:47.449011 23283 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:47.449157 23283 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:47.449374 23283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:47.451474 23283 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } }
I20260808 14:56:47.451959 23283 leader_election.cc:302] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80fc452b6d8e4c0a8a7147a0dc426fdc; no voters:
I20260808 14:56:47.452543 23283 leader_election.cc:288] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:47.452778 23291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:47.453586 23291 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 1 LEADER]: Becoming Leader. State: Replica: 80fc452b6d8e4c0a8a7147a0dc426fdc, State: Running, Role: LEADER
I20260808 14:56:47.454173 23291 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } }
I20260808 14:56:47.454675 23283 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:47.457620 23293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } }
I20260808 14:56:47.458006 23293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:47.458426 23295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80fc452b6d8e4c0a8a7147a0dc426fdc. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } }
I20260808 14:56:47.458770 23295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:47.464747 23312 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:47.469426 23312 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:47.477567 23312 catalog_manager.cc:1347] Generated new cluster ID: 94f6c4af6b0347cd904fd18469068e2a
I20260808 14:56:47.477669 23312 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:47.510138 23312 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:47.512004 23312 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:47.524343 23312 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc: Generated new TSK 0
I20260808 14:56:47.525214 23312 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab.
Entry for principal oryx/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab.
I20260808 14:56:47.590993 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33041
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab
--principal=oryx/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:44131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:47.957373 23327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:47.957682 23327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:47.957828 23327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:47.965664 23327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:47.965803 23327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:47.965991 23327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:56:47.975636 23327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:44131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab
--principal=oryx/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:47.976938 23327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:47.978361 23327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:47.991744 23336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:47.991974 23340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:47.992316 23337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:47.992738 23327 server_base.cc:1034] running on GCE node
I20260808 14:56:47.993423 23327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:47.994354 23327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:47.995570 23327 hybrid_clock.cc:648] HybridClock initialized: now 1786201007995504 us; error 50 us; skew 500 ppm
I20260808 14:56:47.995891 23327 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:47 dist-test-slave-z8x9 krb5kdc[23143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201007, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:47.999440 23327 init.cc:377] Logged in from keytab as oryx/127.12.73.129@KRBTEST.COM (short username oryx)
I20260808 14:56:48.000871 23327 webserver.cc:460] Webserver started at http://127.12.73.129:36935/ using document root <none> and password file <none>
I20260808 14:56:48.001637 23327 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:48.001789 23327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:48.002108 23327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:48.005004 23327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "98cecc11e2664821a6edf4742860bb92"
format_stamp: "Formatted at 2026-08-08 14:56:47 on dist-test-slave-z8x9"
server_key: "90defc2c05106c7030683b39d58bc5fc"
server_key_iv: "5e1dd121a04f3ac83c7f9f3c2476f04e"
server_key_version: "encryptionkey@0"
I20260808 14:56:48.005887 23327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "98cecc11e2664821a6edf4742860bb92"
format_stamp: "Formatted at 2026-08-08 14:56:47 on dist-test-slave-z8x9"
server_key: "90defc2c05106c7030683b39d58bc5fc"
server_key_iv: "5e1dd121a04f3ac83c7f9f3c2476f04e"
server_key_version: "encryptionkey@0"
I20260808 14:56:48.011123 23327 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:56:48.015100 23355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:48.016382 23327 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:56:48.016567 23327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "98cecc11e2664821a6edf4742860bb92"
format_stamp: "Formatted at 2026-08-08 14:56:47 on dist-test-slave-z8x9"
server_key: "90defc2c05106c7030683b39d58bc5fc"
server_key_iv: "5e1dd121a04f3ac83c7f9f3c2476f04e"
server_key_version: "encryptionkey@0"
I20260808 14:56:48.016781 23327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:48.033902 23327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:48.038276 23327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:48.038566 23327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:48.039598 23327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:48.040940 23327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:48.041049 23327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:48.041225 23327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:48.041304 23327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:48.074805 23327 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:38439
I20260808 14:56:48.074851 23548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:38439 every 8 connection(s)
I20260808 14:56:48.076089 23327 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:56:48.080222 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 23327
I20260808 14:56:48.080448 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:56:48.081115 12582 external_mini_cluster.cc:1428] Setting key baf4d6062f3a465a1a421113ffa1efd6
Aug 08 14:56:48 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201007, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:56:48.098438 23553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:48.078706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:46849 (local address 127.12.73.190:33041)
0808 14:56:48.079269 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:48.079274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:48.080071 (+ 797us) server_negotiation.cc:407] Connection header received
0808 14:56:48.082267 (+ 2196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:48.082271 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:48.082353 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:48.082447 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:48.084151 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:48.085347 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:48.086921 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:48.087599 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:48.087753 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:48.091632 (+ 3879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:48.091641 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:48.091649 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:48.091695 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:48.094872 (+ 3177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:48.095816 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:48.095820 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:48.095822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:48.095943 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:48.096458 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:48.096461 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:48.096463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:48.096705 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:48.096814 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:48.097996 (+ 1182us) server_negotiation.cc:299] Negotiation successful
0808 14:56:48.098161 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":446,"thread_start_us":301,"threads_started":1}
I20260808 14:56:48.100039 23554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:48.079149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.129:46849)
0808 14:56:48.079902 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:48.079947 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:48.081996 (+ 2049us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:48.082725 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:48.082736 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:48.083440 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:48.083976 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:48.083992 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:48.085515 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:48.085518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:48.086762 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:48.086775 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:48.087894 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:48.087900 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:48.088098 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:48.088850 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:48.088877 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:48.091419 (+ 2542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:48.095018 (+ 3599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:48.095031 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:48.095049 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:48.095696 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:48.096047 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:48.096054 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:48.096061 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:48.096351 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:48.096861 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:48.096872 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:48.097469 (+ 597us) client_negotiation.cc:769] Sending connection context
0808 14:56:48.097913 (+ 444us) client_negotiation.cc:240] Negotiation successful
0808 14:56:48.098501 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":323,"threads_started":1}
I20260808 14:56:48.101713 23550 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33041
I20260808 14:56:48.102021 23550 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:48.102741 23550 heartbeater.cc:511] Master 127.12.73.190:33041 requested a full tablet report, sending...
I20260808 14:56:48.104801 23220 ts_manager.cc:194] Registered new tserver with Master: 98cecc11e2664821a6edf4742860bb92 (127.12.73.129:38439)
I20260808 14:56:48.106282 23220 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:46849
WARNING: no policy specified for oryx/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab.
Entry for principal oryx/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab.
I20260808 14:56:48.140683 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33041
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab
--principal=oryx/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:44131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:48.476130 23557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:48.476390 23557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:48.476511 23557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:48.483695 23557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:48.483861 23557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:48.484053 23557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:56:48.493786 23557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:44131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab
--principal=oryx/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:48.495064 23557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:48.496428 23557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:48.509445 23571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:48.509500 23568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:48.509394 23567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:48.510444 23557 server_base.cc:1034] running on GCE node
I20260808 14:56:48.511044 23557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:48.511955 23557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:48.513221 23557 hybrid_clock.cc:648] HybridClock initialized: now 1786201008513147 us; error 43 us; skew 500 ppm
I20260808 14:56:48.513558 23557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:48 dist-test-slave-z8x9 krb5kdc[23143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201008, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:48.520044 23557 init.cc:377] Logged in from keytab as oryx/127.12.73.130@KRBTEST.COM (short username oryx)
I20260808 14:56:48.521682 23557 webserver.cc:460] Webserver started at http://127.12.73.130:43329/ using document root <none> and password file <none>
I20260808 14:56:48.522373 23557 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:48.522521 23557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:48.522847 23557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:48.525846 23557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "a4e6d619d8a54a5ea710ecdbac8c014e"
format_stamp: "Formatted at 2026-08-08 14:56:48 on dist-test-slave-z8x9"
server_key: "3aea250268697cf25b5ef0ed66ca7fd9"
server_key_iv: "a6e11e8f710fa2e31b64329b3903234d"
server_key_version: "encryptionkey@0"
I20260808 14:56:48.526651 23557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "a4e6d619d8a54a5ea710ecdbac8c014e"
format_stamp: "Formatted at 2026-08-08 14:56:48 on dist-test-slave-z8x9"
server_key: "3aea250268697cf25b5ef0ed66ca7fd9"
server_key_iv: "a6e11e8f710fa2e31b64329b3903234d"
server_key_version: "encryptionkey@0"
I20260808 14:56:48.531719 23557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 14:56:48.535184 23583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:48.536507 23557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:56:48.536684 23557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "a4e6d619d8a54a5ea710ecdbac8c014e"
format_stamp: "Formatted at 2026-08-08 14:56:48 on dist-test-slave-z8x9"
server_key: "3aea250268697cf25b5ef0ed66ca7fd9"
server_key_iv: "a6e11e8f710fa2e31b64329b3903234d"
server_key_version: "encryptionkey@0"
I20260808 14:56:48.536899 23557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:48.551841 23557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:48.556329 23557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:48.556625 23557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:48.557637 23557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:48.559098 23557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:48.559201 23557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:48.559343 23557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:48.559422 23557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:48.592499 23557 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:37051
I20260808 14:56:48.592540 23758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:37051 every 8 connection(s)
I20260808 14:56:48.593801 23557 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:56:48.596024 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 23557
I20260808 14:56:48.596212 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:56:48.596841 12582 external_mini_cluster.cc:1428] Setting key 10c00f28424356d87174dac74ce055f3
Aug 08 14:56:48 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201008, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:56:48.614161 23553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:48.596554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:60537 (local address 127.12.73.190:33041)
0808 14:56:48.596727 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:48.596732 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:48.598277 (+ 1545us) server_negotiation.cc:407] Connection header received
0808 14:56:48.600097 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:48.600103 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:48.600185 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:48.600302 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:48.601971 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:48.602675 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:48.604171 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:48.604608 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:48.604745 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:48.608246 (+ 3501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:48.608251 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:48.608254 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:48.608286 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:48.610910 (+ 2624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:48.611863 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:48.611867 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:48.611869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:48.611990 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:48.612469 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:48.612472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:48.612474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:48.612710 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:48.612823 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:48.613745 (+ 922us) server_negotiation.cc:299] Negotiation successful
0808 14:56:48.613923 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:56:48.615598 23761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:48.597210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.130:60537)
0808 14:56:48.598129 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:48.598175 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:48.599850 (+ 1675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:48.600537 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:48.600545 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:48.601203 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:48.601807 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:48.601825 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:48.602845 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:48.602848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:48.604027 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:48.604039 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:48.604839 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:48.604846 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:48.605080 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:48.605822 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:48.605843 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:48.608009 (+ 2166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:48.611052 (+ 3043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:48.611064 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:48.611082 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:48.611736 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:48.612098 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:48.612105 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:48.612112 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:48.612360 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:48.612844 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:48.612855 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:48.613357 (+ 502us) client_negotiation.cc:769] Sending connection context
0808 14:56:48.613645 (+ 288us) client_negotiation.cc:240] Negotiation successful
0808 14:56:48.614185 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":364,"threads_started":1}
I20260808 14:56:48.617043 23759 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33041
I20260808 14:56:48.617424 23759 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:48.618309 23759 heartbeater.cc:511] Master 127.12.73.190:33041 requested a full tablet report, sending...
I20260808 14:56:48.619917 23220 ts_manager.cc:194] Registered new tserver with Master: a4e6d619d8a54a5ea710ecdbac8c014e (127.12.73.130:37051)
I20260808 14:56:48.620870 23220 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:60537
WARNING: no policy specified for oryx/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab.
Entry for principal oryx/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab.
I20260808 14:56:48.654279 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33041
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab
--principal=oryx/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:44131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:48.985280 23767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:48.985548 23767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:48.985643 23767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:48.992591 23767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:48.992691 23767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:48.992801 23767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:56:49.002219 23767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:44131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab
--principal=oryx/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:49.003427 23767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:49.004709 23767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:49.017599 23774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:49.017629 23777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:49.017696 23775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:49.019013 23767 server_base.cc:1034] running on GCE node
I20260808 14:56:49.019702 23767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:49.020781 23767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:49.022006 23767 hybrid_clock.cc:648] HybridClock initialized: now 1786201009021963 us; error 54 us; skew 500 ppm
I20260808 14:56:49.022336 23767 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:49 dist-test-slave-z8x9 krb5kdc[23143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201009, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:49.025542 23767 init.cc:377] Logged in from keytab as oryx/127.12.73.131@KRBTEST.COM (short username oryx)
I20260808 14:56:49.026947 23767 webserver.cc:460] Webserver started at http://127.12.73.131:37081/ using document root <none> and password file <none>
I20260808 14:56:49.027609 23767 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:49.027758 23767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:49.028059 23767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:49.031028 23767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "07f82f449cc24186af5e93b4be94a7cb"
format_stamp: "Formatted at 2026-08-08 14:56:49 on dist-test-slave-z8x9"
server_key: "ffd5270ede159dab1425a73607e61cbb"
server_key_iv: "4fd1f23b703bd1d3b5cc30abb5451d33"
server_key_version: "encryptionkey@0"
I20260808 14:56:49.031813 23767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "07f82f449cc24186af5e93b4be94a7cb"
format_stamp: "Formatted at 2026-08-08 14:56:49 on dist-test-slave-z8x9"
server_key: "ffd5270ede159dab1425a73607e61cbb"
server_key_iv: "4fd1f23b703bd1d3b5cc30abb5451d33"
server_key_version: "encryptionkey@0"
I20260808 14:56:49.036954 23767 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:56:49.040411 23786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:49.041858 23767 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:49.042023 23767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "07f82f449cc24186af5e93b4be94a7cb"
format_stamp: "Formatted at 2026-08-08 14:56:49 on dist-test-slave-z8x9"
server_key: "ffd5270ede159dab1425a73607e61cbb"
server_key_iv: "4fd1f23b703bd1d3b5cc30abb5451d33"
server_key_version: "encryptionkey@0"
I20260808 14:56:49.042227 23767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:49.058167 23767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:49.062645 23767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:49.062897 23767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:49.063776 23767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:49.065058 23767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:49.065148 23767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:49.065315 23767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:49.065371 23767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:49.100664 23767 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:34879
I20260808 14:56:49.100699 23966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:34879 every 8 connection(s)
I20260808 14:56:49.101965 23767 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:56:49.109138 23550 heartbeater.cc:503] Master 127.12.73.190:33041 was elected leader, sending a full tablet report...
I20260808 14:56:49.109965 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 23767
I20260808 14:56:49.110159 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:56:49.110736 12582 external_mini_cluster.cc:1428] Setting key d5ff0d24f43fb7813e0f8d1c2dcc3691
Aug 08 14:56:49 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201009, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:56:49.122722 23553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.104696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:39871 (local address 127.12.73.190:33041)
0808 14:56:49.104913 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:49.104919 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:49.106117 (+ 1198us) server_negotiation.cc:407] Connection header received
0808 14:56:49.107841 (+ 1724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:49.107845 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:49.107917 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:49.108013 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:49.109674 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.110712 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.112820 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.113307 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.113452 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.116932 (+ 3480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:49.116937 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:49.116941 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:49.116972 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:49.119560 (+ 2588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.120383 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.120387 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.120389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.120522 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.121004 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.121007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.121009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.121411 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:49.121526 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:49.122219 (+ 693us) server_negotiation.cc:299] Negotiation successful
0808 14:56:49.122472 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:56:49.123723 23971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.105224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.131:39871)
0808 14:56:49.105942 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:49.105979 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:49.107589 (+ 1610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:49.108208 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:49.108214 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:49.108703 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:49.109486 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.109514 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.111037 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.111044 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.112671 (+ 1627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.112686 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.113540 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.113550 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.113811 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.114457 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:49.114478 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:49.116741 (+ 2263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:49.119693 (+ 2952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.119699 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.119710 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.120276 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.120651 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.120654 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.120657 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.120904 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.121543 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:49.121549 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:49.121890 (+ 341us) client_negotiation.cc:769] Sending connection context
0808 14:56:49.122137 (+ 247us) client_negotiation.cc:240] Negotiation successful
0808 14:56:49.122627 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":274,"threads_started":1}
I20260808 14:56:49.125554 23968 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33041
I20260808 14:56:49.125902 23968 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:49.126708 23968 heartbeater.cc:511] Master 127.12.73.190:33041 requested a full tablet report, sending...
I20260808 14:56:49.128175 23220 ts_manager.cc:194] Registered new tserver with Master: 07f82f449cc24186af5e93b4be94a7cb (127.12.73.131:34879)
I20260808 14:56:49.129048 23220 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:39871
I20260808 14:56:49.138595 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.73.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.189.keytab.
Entry for principal oryx/127.12.73.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.189.keytab.
I20260808 14:56:49.196941 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.189:35655
--webserver_interface=127.12.73.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.189.keytab
--principal=oryx/127.12.73.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:44131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:33041,127.12.73.189:35655
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:49.527434 23977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:49.527709 23977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:49.527832 23977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:49.535219 23977 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:49.535333 23977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:49.535382 23977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:49.535432 23977 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:49.535504 23977 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:49.545763 23977 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:44131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:33041,127.12.73.189:35655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.189.keytab
--principal=oryx/127.12.73.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.189:35655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.73.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
W20260808 14:56:49.546139 23977 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.73.190:33041,127.12.73.189:35655'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 14:56:49.547345 23977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:49.548683 23977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:49.560745 23989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:49.560799 23992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:49.560842 23988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:49.561631 23977 server_base.cc:1034] running on GCE node
I20260808 14:56:49.562392 23977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:49.563717 23977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:49.564965 23977 hybrid_clock.cc:648] HybridClock initialized: now 1786201009564913 us; error 48 us; skew 500 ppm
I20260808 14:56:49.565351 23977 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:49 dist-test-slave-z8x9 krb5kdc[23143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201009, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:49.568423 23977 init.cc:377] Logged in from keytab as oryx/127.12.73.189@KRBTEST.COM (short username oryx)
I20260808 14:56:49.569947 23977 webserver.cc:460] Webserver started at http://127.12.73.189:35949/ using document root <none> and password file <none>
I20260808 14:56:49.570638 23977 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:49.570777 23977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:49.571100 23977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:49.574021 23977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data/instance:
uuid: "3a171e960906486dbf7e021325e12b2b"
format_stamp: "Formatted at 2026-08-08 14:56:49 on dist-test-slave-z8x9"
server_key: "6a826618b0e29a34d294ae2289c4f5ef"
server_key_iv: "b1eaee05034665456caee97784b6830c"
server_key_version: "encryptionkey@0"
I20260808 14:56:49.574802 23977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/wal/instance:
uuid: "3a171e960906486dbf7e021325e12b2b"
format_stamp: "Formatted at 2026-08-08 14:56:49 on dist-test-slave-z8x9"
server_key: "6a826618b0e29a34d294ae2289c4f5ef"
server_key_iv: "b1eaee05034665456caee97784b6830c"
server_key_version: "encryptionkey@0"
I20260808 14:56:49.579968 23977 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:56:49.583470 24004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:49.584810 23977 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:56:49.584959 23977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/wal
uuid: "3a171e960906486dbf7e021325e12b2b"
format_stamp: "Formatted at 2026-08-08 14:56:49 on dist-test-slave-z8x9"
server_key: "6a826618b0e29a34d294ae2289c4f5ef"
server_key_iv: "b1eaee05034665456caee97784b6830c"
server_key_version: "encryptionkey@0"
I20260808 14:56:49.585131 23977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:49.621640 23977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:49.623996 23759 heartbeater.cc:503] Master 127.12.73.190:33041 was elected leader, sending a full tablet report...
I20260808 14:56:49.626277 23977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:49.626551 23977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:49.646266 23977 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.189:35655
I20260808 14:56:49.646287 24097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.189:35655 every 8 connection(s)
I20260808 14:56:49.647974 23977 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
I20260808 14:56:49.649322 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 23977
I20260808 14:56:49.654397 24098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:49.664474 24098 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:56:49 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.73.189@KRBTEST.COM
Aug 08 14:56:49 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201009, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.189@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:56:49.678449 24103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.653751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46128 (local address 127.12.73.189:35655)
0808 14:56:49.658111 (+ 4360us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:49.658131 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:49.658185 (+ 54us) server_negotiation.cc:407] Connection header received
0808 14:56:49.660596 (+ 2411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:49.660619 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:49.661081 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:49.661557 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:49.663095 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.664360 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.665710 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.666361 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.666549 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.671056 (+ 4507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:49.671063 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:49.671073 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:49.671105 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:49.674346 (+ 3241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.675232 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.675238 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.675243 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.675437 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.675906 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.675909 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.675911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.676469 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:49.676801 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:49.677097 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 14:56:49.677555 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4067,"thread_start_us":3790,"threads_started":1}
I20260808 14:56:49.682272 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.666829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:36312)
0808 14:56:49.668085 (+ 1256us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:49.668124 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:49.668246 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:49.668670 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:49.668674 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:49.669363 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:49.669597 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.669605 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.670768 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.670778 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.672022 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.672034 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.672802 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.672809 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.672965 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.673567 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:49.673583 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:49.676143 (+ 2560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:49.679613 (+ 3470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.679622 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.679628 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.680246 (+ 618us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.680593 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.680598 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.680601 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.680758 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.681475 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:49.681481 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:49.681622 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 14:56:49.681803 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 14:56:49.682017 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1087,"thread_start_us":419,"threads_started":1}
I20260808 14:56:49.682296 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.666819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36312 (local address 127.12.73.190:33041)
0808 14:56:49.667686 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:49.667692 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:49.668221 (+ 529us) server_negotiation.cc:407] Connection header received
0808 14:56:49.668378 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:49.668386 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:49.668480 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:49.668601 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:49.669750 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.670618 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.672174 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.672574 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.672719 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.676330 (+ 3611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:49.676336 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:49.676341 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:49.676378 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:49.679497 (+ 3119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.680353 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.680357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.680359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.680485 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.680916 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.680924 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.680929 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.681359 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:49.681480 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:49.681893 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 14:56:49.682060 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":603,"threads_started":1}
I20260808 14:56:49.683763 24098 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:56:49 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201009, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.189@KRBTEST.COM for oryx/127.12.73.189@KRBTEST.COM
I20260808 14:56:49.695327 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.684329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:35655 (local address 127.0.0.1:46132)
0808 14:56:49.684523 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:49.684541 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:49.684641 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:49.684948 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:49.684952 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:49.685381 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:49.685498 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.685506 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.686431 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.686436 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.687261 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.687271 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.687959 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.687965 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.688155 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.688660 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:49.688700 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:49.690657 (+ 1957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:49.693475 (+ 2818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.693478 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.693480 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.693810 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.694108 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.694111 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.694113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.694241 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.694671 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:49.694674 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:49.694780 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 14:56:49.694891 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 14:56:49.695078 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 14:56:49.695508 24103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.684377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46132 (local address 127.12.73.189:35655)
0808 14:56:49.684517 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:49.684522 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:49.684599 (+ 77us) server_negotiation.cc:407] Connection header received
0808 14:56:49.684755 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:49.684760 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:49.684836 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:49.684932 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:49.685624 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.686291 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.687394 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.687805 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.687945 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.690807 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:49.690812 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:49.690815 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:49.690848 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:49.693363 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.693903 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.693907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.693909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.694010 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.694326 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.694329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.694331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.694579 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:49.694680 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:49.694970 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 14:56:49.695193 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":42}
I20260808 14:56:49.699934 24098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: Bootstrap starting.
I20260808 14:56:49.702925 24098 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:49.703923 24098 log.cc:824] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:49.706455 24098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: No bootstrap required, opened a new log
I20260808 14:56:49.713315 24098 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } }
I20260808 14:56:49.713657 24098 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:49.713765 24098 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a171e960906486dbf7e021325e12b2b, State: Initialized, Role: FOLLOWER
I20260808 14:56:49.714310 24098 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } }
I20260808 14:56:49.715094 24107 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } } }
I20260808 14:56:49.715407 24107 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:56:49.716055 24098 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: configured and running, proceeding with master startup.
W20260808 14:56:49.724503 24126 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:56:49.724632 24126 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:56:49.726444 23977 master_runner.cc:428] Detected that this master 3a171e960906486dbf7e021325e12b2b is joining an existing cluster
I20260808 14:56:49.726549 23977 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.73.189:35655
I20260808 14:56:49.747004 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.730285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36324 (local address 127.12.73.190:33041)
0808 14:56:49.730506 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:49.730515 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:49.731134 (+ 619us) server_negotiation.cc:407] Connection header received
0808 14:56:49.731422 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:49.731428 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:49.731522 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:49.731597 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:49.733136 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.734284 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.736392 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.737068 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.737225 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.739902 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:49.739910 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:49.739915 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:49.739955 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:49.743698 (+ 3743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.744575 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.744581 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.744584 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.744734 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.745231 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.745239 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.745243 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.745591 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:49.745708 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:49.746413 (+ 705us) server_negotiation.cc:299] Negotiation successful
0808 14:56:49.746648 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:56:49.747423 24135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.730287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:36324)
0808 14:56:49.731020 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:49.731041 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:49.731249 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:49.731813 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:49.731818 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:49.732551 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:49.732951 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.732965 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.734481 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.734486 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.736198 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.736214 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.737534 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.737541 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.737725 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.738479 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:49.738503 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:49.739681 (+ 1178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:49.743863 (+ 4182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.743867 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.743871 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.744402 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.744899 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.744903 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.744907 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.745086 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.745802 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:49.745808 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:49.746057 (+ 249us) client_negotiation.cc:769] Sending connection context
0808 14:56:49.746274 (+ 217us) client_negotiation.cc:240] Negotiation successful
0808 14:56:49.746693 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"mutex_wait_us":102,"thread_start_us":367,"threads_started":1}
I20260808 14:56:49.758976 24138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.731090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:35655 (local address 127.0.0.1:46142)
0808 14:56:49.742566 (+ 11476us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:49.742588 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:49.742752 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:49.743216 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:49.743223 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:49.743852 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:49.744212 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.744224 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.745819 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.745823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.747538 (+ 1715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.747553 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.748925 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.748933 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.749151 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.749834 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:49.749872 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:49.750859 (+ 987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:49.755817 (+ 4958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.755826 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.755830 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.756408 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.756826 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.756831 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.756835 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.757001 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.757703 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:49.757708 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:49.757871 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 14:56:49.758012 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 14:56:49.758320 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11327,"mutex_wait_us":35,"thread_start_us":10845,"threads_started":1}
I20260808 14:56:49.760041 24103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.731302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46142 (local address 127.12.73.189:35655)
0808 14:56:49.731467 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:49.731473 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:49.742666 (+ 11193us) server_negotiation.cc:407] Connection header received
0808 14:56:49.742879 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:49.742883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:49.742952 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:49.743018 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:49.744357 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.745524 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.747739 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.748491 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.748623 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.751079 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:49.751086 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:49.751096 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:49.751132 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:49.755673 (+ 4541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.756563 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.756568 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.756572 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.756711 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.757149 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.757153 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.757157 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.757564 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:49.758975 (+ 1411us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:49.759474 (+ 499us) server_negotiation.cc:299] Negotiation successful
0808 14:56:49.759699 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 14:56:49 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201007, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.190@KRBTEST.COM for oryx/127.12.73.189@KRBTEST.COM
WARNING: no policy specified for oryx/127.12.73.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.188@KRBTEST.COM" created.
I20260808 14:56:49.775068 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.754819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46146 (local address 127.12.73.189:35655)
0808 14:56:49.756138 (+ 1319us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:49.756146 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:49.756214 (+ 68us) server_negotiation.cc:407] Connection header received
0808 14:56:49.756302 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:49.756309 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:49.756405 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:49.758087 (+ 1682us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:49.758433 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.760307 (+ 1874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.762591 (+ 2284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.763432 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.763568 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.768019 (+ 4451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:49.768028 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:49.768033 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:49.768072 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:49.771871 (+ 3799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.772660 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.772667 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.772670 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.772843 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.773371 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.773375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.773377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.773699 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:49.773862 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:49.774391 (+ 529us) server_negotiation.cc:299] Negotiation successful
0808 14:56:49.774614 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1165,"thread_start_us":958,"threads_started":1}
I20260808 14:56:49.775065 24140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.754283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:35655 (local address 127.0.0.1:46146)
0808 14:56:49.755304 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:49.755349 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:49.755490 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:49.756598 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:49.756608 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:49.757580 (+ 972us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:49.757939 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.757954 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.760462 (+ 2508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.760470 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.762397 (+ 1927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.762415 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.763619 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.763626 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.763858 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.764574 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:49.764599 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:49.767758 (+ 3159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:49.772011 (+ 4253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.772022 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.772028 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.772516 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.772979 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.772987 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.772994 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.773214 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.773854 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:49.773864 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:49.774081 (+ 217us) client_negotiation.cc:769] Sending connection context
0808 14:56:49.774272 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 14:56:49.774617 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"thread_start_us":849,"threads_started":1}
I20260808 14:56:49.777668 23220 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.73.189:35655: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3a171e960906486dbf7e021325e12b2b"
member_type: NON_VOTER
last_known_addr {
host: "127.12.73.189"
port: 35655
}
attrs {
promote: true
}
}
dest_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc"
cas_config_opid_index: -1
I20260808 14:56:49.779018 23220 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true } }
I20260808 14:56:49.786422 24147 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3a171e960906486dbf7e021325e12b2b (127.12.73.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true } } }
I20260808 14:56:49.787657 24051 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:49.791253 24147 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.73.189:35655
I20260808 14:56:49.792390 23977 master.cc:537] Master@127.12.73.189:35655 shutting down...
I20260808 14:56:49.793780 24051 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 FOLLOWER]: Refusing update from remote peer 80fc452b6d8e4c0a8a7147a0dc426fdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 14:56:49.794167 24145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true } } }
I20260808 14:56:49.794469 24145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:49.795112 24147 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:56:49.800279 23193 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 14:56:49.803874 23193 consensus_peers.cc:487] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc -> Peer 3a171e960906486dbf7e021325e12b2b (127.12.73.189:35655): Couldn't send request to peer 3a171e960906486dbf7e021325e12b2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 14:56:49.810544 23977 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:49.811003 23977 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:49.811215 23977 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.188.keytab.
Entry for principal oryx/127.12.73.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.188.keytab.
I20260808 14:56:49.820972 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.188:33723
--webserver_interface=127.12.73.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.188.keytab
--principal=oryx/127.12.73.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:44131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:33041,127.12.73.189:35655,127.12.73.188:33723
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:56:49.828562 23977 master.cc:552] Master@127.12.73.189:35655 shutdown complete.
I20260808 14:56:49.828804 23977 master_runner.cc:305] Clearing existing system tablet
I20260808 14:56:49.829411 23977 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:49.829526 23977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:49.832821 23977 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:56:49.834525 24157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:49.834887 23977 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:49.835193 23977 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:56:49.835283 23977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/wal
uuid: "3a171e960906486dbf7e021325e12b2b"
format_stamp: "Formatted at 2026-08-08 14:56:49 on dist-test-slave-z8x9"
server_key: "6a826618b0e29a34d294ae2289c4f5ef"
server_key_iv: "b1eaee05034665456caee97784b6830c"
server_key_version: "encryptionkey@0"
I20260808 14:56:49.838762 23977 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:49.843644 23977 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 14:56:49.843855 23977 log.cc:1196] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 14:56:49.844368 23977 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: Deleting consensus metadata
I20260808 14:56:49.844640 23977 master_runner.cc:315] Copying system tablet from 127.12.73.190:33041
I20260808 14:56:49.851006 23977 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: tablet copy: Beginning tablet copy session from remote peer at address 127.12.73.190:33041
I20260808 14:56:49.865686 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.851944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36340 (local address 127.12.73.190:33041)
0808 14:56:49.852176 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:49.852186 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:49.853719 (+ 1533us) server_negotiation.cc:407] Connection header received
0808 14:56:49.853982 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:49.853986 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:49.854052 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:49.854162 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:49.855091 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.855966 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.857227 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.857655 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.857805 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.859858 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:49.859871 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:49.859875 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:49.859908 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:49.862854 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.863540 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.863547 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.863551 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.863692 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:49.864077 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:49.864082 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:49.864086 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:49.864376 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:49.864669 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:49.865005 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 14:56:49.865273 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:56:49.865715 24166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:49.851896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:36340)
0808 14:56:49.853593 (+ 1697us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:49.853614 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:49.853801 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:49.854187 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:49.854191 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:49.854729 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:49.854936 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.854945 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.856101 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.856108 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.857026 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:49.857042 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:49.857819 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:49.857825 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:49.858016 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:49.858698 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:49.858716 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:49.859559 (+ 843us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:49.862989 (+ 3430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.862996 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.863000 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.863409 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.863808 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:49.863813 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:49.863817 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:49.863964 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:49.864507 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:49.864512 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:49.864733 (+ 221us) client_negotiation.cc:769] Sending connection context
0808 14:56:49.864907 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 14:56:49.865263 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1533,"thread_start_us":1438,"threads_started":1}
I20260808 14:56:49.866930 23255 tablet_copy_service.cc:140] P 80fc452b6d8e4c0a8a7147a0dc426fdc: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3a171e960906486dbf7e021325e12b2b ({username='oryx', principal='oryx/127.12.73.189@KRBTEST.COM'} at 127.0.0.1:36340)
I20260808 14:56:49.867379 23255 tablet_copy_service.cc:161] P 80fc452b6d8e4c0a8a7147a0dc426fdc: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3a171e960906486dbf7e021325e12b2b at {username='oryx', principal='oryx/127.12.73.189@KRBTEST.COM'} at 127.0.0.1:36340: session id = 3a171e960906486dbf7e021325e12b2b-00000000000000000000000000000000
I20260808 14:56:49.870894 23255 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 14:56:49.873106 23977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 14:56:49.878116 23977 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: tablet copy: Starting download of 0 data blocks...
I20260808 14:56:49.878485 23977 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: tablet copy: Starting download of 1 WAL segments...
I20260808 14:56:49.881765 23977 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 14:56:49.885061 23255 tablet_copy_service.cc:342] P 80fc452b6d8e4c0a8a7147a0dc426fdc: Request end of tablet copy session 3a171e960906486dbf7e021325e12b2b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.73.189@KRBTEST.COM'} at 127.0.0.1:36340
I20260808 14:56:49.885347 23255 tablet_copy_service.cc:433] P 80fc452b6d8e4c0a8a7147a0dc426fdc: ending tablet copy session 3a171e960906486dbf7e021325e12b2b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3a171e960906486dbf7e021325e12b2b
I20260808 14:56:49.898370 23977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:49.901512 24168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:49.902127 24171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:49.913789 24173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:49.914198 23977 server_base.cc:1034] running on GCE node
I20260808 14:56:49.914564 23977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:49.915279 23977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:49.916513 23977 hybrid_clock.cc:648] HybridClock initialized: now 1786201009916389 us; error 91 us; skew 500 ppm
I20260808 14:56:49.916760 23977 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:49 dist-test-slave-z8x9 krb5kdc[23143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201009, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:49.919114 23977 init.cc:377] Logged in from keytab as oryx/127.12.73.189@KRBTEST.COM (short username oryx)
I20260808 14:56:49.921283 23977 webserver.cc:460] Webserver started at http://127.12.73.189:46629/ using document root <none> and password file <none>
I20260808 14:56:49.921676 23977 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:49.921788 23977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:49.925269 23977 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:56:49.927366 24185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:49.927879 23977 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:56:49.928066 23977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/wal
uuid: "3a171e960906486dbf7e021325e12b2b"
format_stamp: "Formatted at 2026-08-08 14:56:49 on dist-test-slave-z8x9"
server_key: "6a826618b0e29a34d294ae2289c4f5ef"
server_key_iv: "b1eaee05034665456caee97784b6830c"
server_key_version: "encryptionkey@0"
I20260808 14:56:49.928284 23977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:49.944602 23977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:49.949148 23977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:49.973153 23977 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.189:35655
I20260808 14:56:49.973215 24262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.189:35655 every 8 connection(s)
I20260808 14:56:49.974400 23977 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
I20260808 14:56:49.982087 24264 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:56:49.986250 24264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: Bootstrap starting.
I20260808 14:56:50.004594 24264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:56:50.005295 24264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: Bootstrap complete.
I20260808 14:56:50.006490 24264 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true } }
I20260808 14:56:50.006816 24264 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3a171e960906486dbf7e021325e12b2b, State: Initialized, Role: LEARNER
I20260808 14:56:50.007090 24264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true } }
I20260808 14:56:50.008014 24268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true } } }
I20260808 14:56:50.008358 24264 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:50.008502 24268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: This master's current role is: LEARNER
I20260808 14:56:50.013903 24285 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:56:50.131563 23968 heartbeater.cc:503] Master 127.12.73.190:33041 was elected leader, sending a full tablet report...
W20260808 14:56:50.222121 24155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:50.222468 24155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:50.222625 24155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:50.230130 24155 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:50.230283 24155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:50.230384 24155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:50.230487 24155 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:50.230563 24155 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:50.240440 24155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:44131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:33041,127.12.73.189:35655,127.12.73.188:33723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.188.keytab
--principal=oryx/127.12.73.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.188:33723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.73.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:50.241909 24155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:50.243244 24155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:50.255374 24293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:50.255378 24299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:50.255336 24297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:50.256366 24155 server_base.cc:1034] running on GCE node
I20260808 14:56:50.257239 24155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:50.258689 24155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:50.259912 24155 hybrid_clock.cc:648] HybridClock initialized: now 1786201010259878 us; error 47 us; skew 500 ppm
I20260808 14:56:50.260253 24155 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:50 dist-test-slave-z8x9 krb5kdc[23143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201010, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:50.263608 24155 init.cc:377] Logged in from keytab as oryx/127.12.73.188@KRBTEST.COM (short username oryx)
I20260808 14:56:50.265022 24155 webserver.cc:460] Webserver started at http://127.12.73.188:42543/ using document root <none> and password file <none>
I20260808 14:56:50.265745 24155 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:50.265900 24155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:50.266208 24155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:50.269090 24155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data/instance:
uuid: "a774ed42d1cc48eb9aea7c34edbf0b62"
format_stamp: "Formatted at 2026-08-08 14:56:50 on dist-test-slave-z8x9"
server_key: "5c6ea54b895595d48e2c80532d823183"
server_key_iv: "249b4a404befbb62fe5d12aafa9a8336"
server_key_version: "encryptionkey@0"
I20260808 14:56:50.269915 24155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/wal/instance:
uuid: "a774ed42d1cc48eb9aea7c34edbf0b62"
format_stamp: "Formatted at 2026-08-08 14:56:50 on dist-test-slave-z8x9"
server_key: "5c6ea54b895595d48e2c80532d823183"
server_key_iv: "249b4a404befbb62fe5d12aafa9a8336"
server_key_version: "encryptionkey@0"
I20260808 14:56:50.274784 24155 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:56:50.278096 24307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:50.279306 24155 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:50.279484 24155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/wal
uuid: "a774ed42d1cc48eb9aea7c34edbf0b62"
format_stamp: "Formatted at 2026-08-08 14:56:50 on dist-test-slave-z8x9"
server_key: "5c6ea54b895595d48e2c80532d823183"
server_key_iv: "249b4a404befbb62fe5d12aafa9a8336"
server_key_version: "encryptionkey@0"
I20260808 14:56:50.279675 24155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:50.307273 24155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:50.311496 24155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:50.311791 24155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:50.330178 24155 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.188:33723
I20260808 14:56:50.330264 24389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.188:33723 every 8 connection(s)
I20260808 14:56:50.331502 24155 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
I20260808 14:56:50.333160 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 24155
I20260808 14:56:50.336918 24391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:50.346810 24391 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:56:50 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.73.188@KRBTEST.COM
Aug 08 14:56:50 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201010, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.188@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:56:50.363080 24396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.335580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54748 (local address 127.12.73.188:33723)
0808 14:56:50.336439 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:50.336456 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:50.336511 (+ 55us) server_negotiation.cc:407] Connection header received
0808 14:56:50.338756 (+ 2245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:50.338782 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:50.339252 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:50.342062 (+ 2810us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:50.342605 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.344651 (+ 2046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.346738 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.347806 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.347979 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.353921 (+ 5942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:50.353928 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:50.353937 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:50.353970 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:50.357979 (+ 4009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.358856 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.358864 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.358872 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.359096 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.359776 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.359785 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.359790 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.360481 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:50.360815 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:50.361318 (+ 503us) server_negotiation.cc:299] Negotiation successful
0808 14:56:50.361719 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":376,"threads_started":1}
I20260808 14:56:50.365123 24401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.336790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46152 (local address 127.12.73.189:35655)
0808 14:56:50.350354 (+ 13564us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:50.350361 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:50.350380 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:56:50.350464 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:50.350472 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:50.350581 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:50.350709 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:50.351787 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.353360 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.355104 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.355890 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.356009 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.358422 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:50.358426 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:50.358429 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:50.358528 (+ 99us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:50.362185 (+ 3657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.363011 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.363016 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.363020 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.363209 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.363678 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.363686 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.363691 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.363970 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:50.364151 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:50.364548 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 14:56:50.364763 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13374,"thread_start_us":13472,"threads_started":1}
I20260808 14:56:50.365213 24399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.336624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:35655 (local address 127.0.0.1:46152)
0808 14:56:50.349795 (+ 13171us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:50.349818 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:50.349951 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:50.350923 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:50.350929 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:50.351382 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:50.351605 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.351615 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.353552 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.353558 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.354942 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.354956 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.356274 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.356280 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.356445 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.357114 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:50.357157 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:50.358239 (+ 1082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:50.362352 (+ 4113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.362359 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.362364 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.362884 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.363362 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.363367 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.363370 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.363559 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.364108 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:50.364115 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:50.364299 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 14:56:50.364454 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 14:56:50.364751 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13033,"spinlock_wait_cycles":8448,"thread_start_us":12939,"threads_started":1}
I20260808 14:56:50.366848 24229 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260808 14:56:50.367561 24268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80fc452b6d8e4c0a8a7147a0dc426fdc. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true } } }
I20260808 14:56:50.367858 24268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: This master's current role is: LEARNER
I20260808 14:56:50.368413 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.350202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36348 (local address 127.12.73.190:33041)
0808 14:56:50.350402 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:50.350408 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:50.351094 (+ 686us) server_negotiation.cc:407] Connection header received
0808 14:56:50.351382 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:50.351387 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:50.351491 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:50.351606 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:50.352998 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.354035 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.356255 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.356894 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.357027 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.361514 (+ 4487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:50.361520 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:50.361524 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:50.361561 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:50.365408 (+ 3847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.366295 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.366300 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.366303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.366475 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.366880 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.366885 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.366889 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.367266 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:50.367418 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:50.367996 (+ 578us) server_negotiation.cc:299] Negotiation successful
0808 14:56:50.368178 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83,"spinlock_wait_cycles":59648}
I20260808 14:56:50.369117 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.350041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:36348)
0808 14:56:50.350953 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:50.351007 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:50.351239 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:50.351688 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:50.351695 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:50.352550 (+ 855us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:50.352835 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.352848 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.354226 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.354232 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.356059 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.356081 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.357069 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.357075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.357332 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.357967 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:50.357989 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:50.361313 (+ 3324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:50.365546 (+ 4233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.365554 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.365559 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.366150 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.366601 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.366604 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.366606 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.366757 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.367404 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:50.367413 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:50.367617 (+ 204us) client_negotiation.cc:769] Sending connection context
0808 14:56:50.368600 (+ 983us) client_negotiation.cc:240] Negotiation successful
0808 14:56:50.368857 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"spinlock_wait_cycles":80256,"thread_start_us":486,"threads_started":1}
I20260808 14:56:50.370445 24391 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:56:50 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201010, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.188@KRBTEST.COM for oryx/127.12.73.189@KRBTEST.COM
I20260808 14:56:50.382128 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.371048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:35655 (local address 127.0.0.1:46158)
0808 14:56:50.371256 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:50.371274 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:50.371371 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:50.371647 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:50.371650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:50.371943 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:50.372070 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.372077 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.372963 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.372966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.373869 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.373881 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.374546 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.374550 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.374682 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.375185 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:50.375201 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:50.377058 (+ 1857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:50.380071 (+ 3013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.380074 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.380076 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.380519 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.380858 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.380861 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.380863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.380977 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.381516 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:50.381519 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:50.381638 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 14:56:50.381749 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 14:56:50.381922 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 14:56:50.382258 24401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.371267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46158 (local address 127.12.73.189:35655)
0808 14:56:50.371413 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:50.371417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:50.371433 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:56:50.371470 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:50.371473 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:50.371540 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:50.371614 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:50.372181 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.372846 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.373986 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.374406 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.374509 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.377274 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:50.377280 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:50.377283 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:50.377310 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:50.379952 (+ 2642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.380617 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.380621 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.380623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.380755 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.381059 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.381062 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.381064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.381408 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:50.381518 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:50.381831 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 14:56:50.381991 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:56:50.383123 24391 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:56:50 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201010, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.188@KRBTEST.COM for oryx/127.12.73.188@KRBTEST.COM
I20260808 14:56:50.394961 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.383924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:33723 (local address 127.0.0.1:54756)
0808 14:56:50.384179 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:50.384194 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:50.384321 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:50.384796 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:50.384802 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:50.385318 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:50.385437 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.385445 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.386355 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.386358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.387136 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.387146 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.387756 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.387760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.387912 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.388347 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:50.388362 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:50.390159 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:50.392925 (+ 2766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.392928 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.392931 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.393377 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.393738 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.393742 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.393744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.393904 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.394339 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:50.394342 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:50.394443 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 14:56:50.394544 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:56:50.394702 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162}
I20260808 14:56:50.395147 24396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.383856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54756 (local address 127.12.73.188:33723)
0808 14:56:50.384068 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:50.384076 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:50.384294 (+ 218us) server_negotiation.cc:407] Connection header received
0808 14:56:50.384538 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:50.384545 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:50.384642 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:50.384749 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:50.385557 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.386224 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.387265 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.387632 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.387723 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.390315 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:50.390319 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:50.390322 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:50.390349 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:50.392802 (+ 2453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.393477 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.393481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.393483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.393603 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.394005 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.394008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.394010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.394242 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:50.394343 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:50.394655 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 14:56:50.394827 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:56:50.399652 24391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: Bootstrap starting.
I20260808 14:56:50.402668 24391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:50.403663 24391 log.cc:824] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:50.406243 24391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: No bootstrap required, opened a new log
I20260808 14:56:50.414008 24391 raft_consensus.cc:348] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } }
I20260808 14:56:50.414386 24391 raft_consensus.cc:374] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:50.414498 24391 raft_consensus.cc:729] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a774ed42d1cc48eb9aea7c34edbf0b62, State: Initialized, Role: FOLLOWER
I20260808 14:56:50.415062 24391 consensus_queue.cc:260] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } }
I20260808 14:56:50.415979 24406 sys_catalog.cc:455] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } } }
I20260808 14:56:50.416340 24406 sys_catalog.cc:458] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:56:50.417256 24391 sys_catalog.cc:564] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 14:56:50.427585 24420 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:56:50.427803 24420 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:56:50.430791 24155 master_runner.cc:428] Detected that this master a774ed42d1cc48eb9aea7c34edbf0b62 is joining an existing cluster
I20260808 14:56:50.430915 24155 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.73.188:33723
I20260808 14:56:50.457054 24396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.437888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54760 (local address 127.12.73.188:33723)
0808 14:56:50.438086 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:50.438092 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:50.438894 (+ 802us) server_negotiation.cc:407] Connection header received
0808 14:56:50.439103 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:50.439110 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:50.439178 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:50.439263 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:50.440656 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.441737 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.444592 (+ 2855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.445349 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.445465 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.448507 (+ 3042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:50.448513 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:50.448518 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:50.448557 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:50.453749 (+ 5192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.454630 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.454635 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.454639 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.454798 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.455264 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.455271 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.455274 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.455726 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:50.455848 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:50.456420 (+ 572us) server_negotiation.cc:299] Negotiation successful
0808 14:56:50.456631 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":60,"spinlock_wait_cycles":3968}
I20260808 14:56:50.457156 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.437256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36358 (local address 127.12.73.190:33041)
0808 14:56:50.437851 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:50.437858 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:50.438206 (+ 348us) server_negotiation.cc:407] Connection header received
0808 14:56:50.438509 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:50.438517 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:50.438609 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:50.438689 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:50.440335 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.441596 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.444080 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.444784 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.444875 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.448060 (+ 3185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:50.448067 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:50.448071 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:50.448116 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:50.452838 (+ 4722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.454531 (+ 1693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.454538 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.454541 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.454711 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.455268 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.455276 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.455279 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.455746 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:50.455875 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:50.456516 (+ 641us) server_negotiation.cc:299] Negotiation successful
0808 14:56:50.456766 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458}
I20260808 14:56:50.458449 24401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.439355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46166 (local address 127.12.73.189:35655)
0808 14:56:50.439535 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:50.439541 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:50.442701 (+ 3160us) server_negotiation.cc:407] Connection header received
0808 14:56:50.442871 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:50.442876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:50.442951 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:50.443025 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:50.444488 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.445497 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.447702 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.448397 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.448489 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.451083 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:50.451091 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:50.451097 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:50.451143 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:50.454712 (+ 3569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.455545 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.455552 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.455556 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.455718 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.456186 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.456191 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.456204 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.456569 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:50.456694 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:50.457787 (+ 1093us) server_negotiation.cc:299] Negotiation successful
0808 14:56:50.458052 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:56:50.458551 24430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.437417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:36358)
0808 14:56:50.438097 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:50.438117 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:50.438326 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:50.438965 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:50.438969 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:50.439761 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:50.440151 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.440162 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.441843 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.441850 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.443898 (+ 2048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.443913 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.445230 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.445239 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.445507 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.446431 (+ 924us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:50.446458 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:50.447850 (+ 1392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:50.452997 (+ 5147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.453004 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.453009 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.454330 (+ 1321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.454858 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.454862 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.454865 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.455102 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.455952 (+ 850us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:50.455959 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:50.456200 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 14:56:50.457453 (+ 1253us) client_negotiation.cc:240] Negotiation successful
0808 14:56:50.457926 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":186,"spinlock_wait_cycles":7168,"thread_start_us":1077,"threads_started":1}
I20260808 14:56:50.459126 24431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.437468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:33723 (local address 127.0.0.1:54760)
0808 14:56:50.438810 (+ 1342us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:50.438831 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:50.438977 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:50.439468 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:50.439472 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:50.440159 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:50.440522 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.440533 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.441944 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.441950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.444440 (+ 2490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.444456 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.445985 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.445991 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.446184 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.447085 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:50.447109 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:50.448319 (+ 1210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:50.453894 (+ 5575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.453900 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.453904 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.454461 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.454935 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.454939 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.454943 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.455125 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.455924 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:50.455930 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:50.456123 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 14:56:50.457390 (+ 1267us) client_negotiation.cc:240] Negotiation successful
0808 14:56:50.457720 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1217,"mutex_wait_us":68,"spinlock_wait_cycles":2304,"thread_start_us":622,"threads_started":1}
I20260808 14:56:50.459870 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.438888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:35655 (local address 127.0.0.1:46166)
0808 14:56:50.442557 (+ 3669us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:50.442574 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:50.442700 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:50.443221 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:50.443226 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:50.443922 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:50.444315 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.444326 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.445747 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.445754 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.447508 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.447522 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.448802 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.448811 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.449040 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.449923 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:50.449950 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:50.450865 (+ 915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:50.454852 (+ 3987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.454856 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.454860 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.455412 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.455875 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.455879 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.455884 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.456036 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.456792 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:50.456796 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:50.456960 (+ 164us) client_negotiation.cc:769] Sending connection context
0808 14:56:50.458043 (+ 1083us) client_negotiation.cc:240] Negotiation successful
0808 14:56:50.458316 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3522,"thread_start_us":3351,"threads_started":1}
Aug 08 14:56:50 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201007, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.190@KRBTEST.COM for oryx/127.12.73.188@KRBTEST.COM
I20260808 14:56:50.471151 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 23327
I20260808 14:56:50.478587 24399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.464066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:33723 (local address 127.0.0.1:54762)
0808 14:56:50.464241 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:50.464257 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:50.464343 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:50.464681 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:50.464689 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:50.465089 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:50.465345 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.465354 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.466332 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.466338 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.467181 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.467191 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.467999 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.468004 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.468190 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.468779 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:50.468798 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:50.471587 (+ 2789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:50.475843 (+ 4256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.475849 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.475853 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.476405 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.476848 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.476852 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.476854 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.476978 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.477625 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:50.477630 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:50.477784 (+ 154us) client_negotiation.cc:769] Sending connection context
0808 14:56:50.477931 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 14:56:50.478228 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 14:56:50.478595 24396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.464115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54762 (local address 127.12.73.188:33723)
0808 14:56:50.464298 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:50.464302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:50.464318 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:56:50.464461 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:50.464464 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:50.464541 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:50.464651 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:50.465500 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.466203 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.467319 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.467848 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.467988 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.471796 (+ 3808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:50.471804 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:50.471808 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:50.471849 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:50.475697 (+ 3848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.476534 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.476539 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.476543 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.476709 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.477112 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.477117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.477133 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.477476 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:50.477666 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:50.478028 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 14:56:50.478260 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:56:50.480399 23220 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.73.188:33723: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62"
member_type: NON_VOTER
last_known_addr {
host: "127.12.73.188"
port: 33723
}
attrs {
promote: true
}
}
dest_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc"
cas_config_opid_index: 5
I20260808 14:56:50.481570 23220 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } }
Aug 08 14:56:50 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.73.129@KRBTEST.COM
I20260808 14:56:50.483485 24393 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a774ed42d1cc48eb9aea7c34edbf0b62 (127.12.73.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } } }
I20260808 14:56:50.493417 24393 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.73.188:33723
I20260808 14:56:50.494048 24155 master.cc:537] Master@127.12.73.188:33723 shutting down...
I20260808 14:56:50.494884 24433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.472197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39188 (local address 127.12.73.129:38439)
0808 14:56:50.472925 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:50.472933 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:50.472968 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:56:50.473025 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:50.473032 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:50.473370 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:50.473617 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:50.475334 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.476617 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.478520 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.479445 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.479573 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.485011 (+ 5438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:50.485025 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:50.485044 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:50.485086 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:50.489502 (+ 4416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.490667 (+ 1165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.490681 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.490688 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.490886 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.491539 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.491547 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.491553 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.492097 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:50.493877 (+ 1780us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:50.494048 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 14:56:50.494406 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":329,"threads_started":1}
I20260808 14:56:50.496722 23542 generic_service.cc:196] Checking for leaks (request via RPC)
W20260808 14:56:50.498365 23194 consensus_peers.cc:487] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc -> Peer a774ed42d1cc48eb9aea7c34edbf0b62 (127.12.73.188:33723): Couldn't send request to peer a774ed42d1cc48eb9aea7c34edbf0b62. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 14:56:50.501336 24229 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 LEARNER]: Refusing update from remote peer 80fc452b6d8e4c0a8a7147a0dc426fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 14:56:50.502765 24393 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 14:56:50.503360 24436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } } }
I20260808 14:56:50.503718 24436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:50.505429 24229 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a774ed42d1cc48eb9aea7c34edbf0b62 (127.12.73.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } } }
I20260808 14:56:50.509406 24268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: NON_VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: true } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } } }
I20260808 14:56:50.509634 24268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: This master's current role is: LEARNER
I20260808 14:56:50.509663 24155 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:50.510074 24155 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:50.510334 24155 tablet_replica.cc:330] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: stopping tablet replica
I20260808 14:56:50.510524 24440 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc: attempting to promote NON_VOTER 3a171e960906486dbf7e021325e12b2b to VOTER
I20260808 14:56:50.511870 24440 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } }
I20260808 14:56:50.514137 24229 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 LEARNER]: Refusing update from remote peer 80fc452b6d8e4c0a8a7147a0dc426fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 14:56:50.515359 24437 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 14:56:50.516269 24399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.515688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:33723 (local address 127.0.0.1:54770)
0808 14:56:50.515920 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:50.516065 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:33723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 14:56:50.516551 23194 consensus_peers.cc:487] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc -> Peer a774ed42d1cc48eb9aea7c34edbf0b62 (127.12.73.188:33723): Couldn't send request to peer a774ed42d1cc48eb9aea7c34edbf0b62. Status: Network error: Client connection negotiation failed: client connection to 127.12.73.188:33723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 14:56:50.518318 24437 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3a171e960906486dbf7e021325e12b2b (127.12.73.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } } }
I20260808 14:56:50.518899 24229 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3a171e960906486dbf7e021325e12b2b (127.12.73.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } } }
I20260808 14:56:50.522425 24393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } } }
I20260808 14:56:50.522758 24393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:50.523066 24393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } } }
I20260808 14:56:50.523339 24393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:50.523356 24268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } } }
I20260808 14:56:50.523590 24268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:56:50.529914 24155 master.cc:552] Master@127.12.73.188:33723 shutdown complete.
I20260808 14:56:50.530022 24155 master_runner.cc:305] Clearing existing system tablet
I20260808 14:56:50.530447 24155 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:50.530592 24155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:50.533332 24155 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:56:50.534838 24448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:50.535148 24155 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:50.535457 24155 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:56:50.535557 24155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/wal
uuid: "a774ed42d1cc48eb9aea7c34edbf0b62"
format_stamp: "Formatted at 2026-08-08 14:56:50 on dist-test-slave-z8x9"
server_key: "5c6ea54b895595d48e2c80532d823183"
server_key_iv: "249b4a404befbb62fe5d12aafa9a8336"
server_key_version: "encryptionkey@0"
I20260808 14:56:50.539055 24155 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:50.543861 24155 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 14:56:50.544049 24155 log.cc:1196] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 14:56:50.544492 24155 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: Deleting consensus metadata
I20260808 14:56:50.544739 24155 master_runner.cc:315] Copying system tablet from 127.12.73.190:33041
I20260808 14:56:50.551193 24155 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: tablet copy: Beginning tablet copy session from remote peer at address 127.12.73.190:33041
I20260808 14:56:50.564894 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.551983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36364 (local address 127.12.73.190:33041)
0808 14:56:50.552260 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:50.552270 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:50.552755 (+ 485us) server_negotiation.cc:407] Connection header received
0808 14:56:50.552981 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:50.552987 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:50.553074 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:50.553206 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:50.553988 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.554815 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.556400 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.556810 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.556885 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.559233 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:50.559238 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:50.559241 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:50.559272 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:50.562068 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.562802 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.562809 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.562813 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.563019 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:50.563436 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:50.563441 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:50.563444 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:50.563738 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:50.563909 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:50.564281 (+ 372us) server_negotiation.cc:299] Negotiation successful
0808 14:56:50.564522 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260808 14:56:50.565303 24461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:50.551955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:36364)
0808 14:56:50.552637 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:50.552656 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:50.552831 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:50.553225 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:50.553229 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:50.553651 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:50.553837 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.553845 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.554977 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.554983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.556237 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:50.556253 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:50.557074 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:50.557079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:50.557362 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:50.558068 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:50.558113 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:50.559014 (+ 901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:50.562220 (+ 3206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.562226 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.562230 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.562683 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.563137 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:50.563143 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:50.563146 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:50.563314 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:50.563862 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:50.563868 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:50.564034 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 14:56:50.564185 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 14:56:50.564522 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":456,"threads_started":1}
I20260808 14:56:50.565932 23255 tablet_copy_service.cc:140] P 80fc452b6d8e4c0a8a7147a0dc426fdc: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a774ed42d1cc48eb9aea7c34edbf0b62 ({username='oryx', principal='oryx/127.12.73.188@KRBTEST.COM'} at 127.0.0.1:36364)
I20260808 14:56:50.566123 23255 tablet_copy_service.cc:161] P 80fc452b6d8e4c0a8a7147a0dc426fdc: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a774ed42d1cc48eb9aea7c34edbf0b62 at {username='oryx', principal='oryx/127.12.73.188@KRBTEST.COM'} at 127.0.0.1:36364: session id = a774ed42d1cc48eb9aea7c34edbf0b62-00000000000000000000000000000000
I20260808 14:56:50.568531 23255 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 14:56:50.570133 24155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 14:56:50.574687 24155 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: tablet copy: Starting download of 0 data blocks...
I20260808 14:56:50.575024 24155 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: tablet copy: Starting download of 1 WAL segments...
I20260808 14:56:50.577219 24155 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 14:56:50.580591 23255 tablet_copy_service.cc:342] P 80fc452b6d8e4c0a8a7147a0dc426fdc: Request end of tablet copy session a774ed42d1cc48eb9aea7c34edbf0b62-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.73.188@KRBTEST.COM'} at 127.0.0.1:36364
I20260808 14:56:50.580737 23255 tablet_copy_service.cc:433] P 80fc452b6d8e4c0a8a7147a0dc426fdc: ending tablet copy session a774ed42d1cc48eb9aea7c34edbf0b62-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a774ed42d1cc48eb9aea7c34edbf0b62
I20260808 14:56:50.590785 24155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:50.593274 24462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:50.596151 24463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:50.603008 24155 server_base.cc:1034] running on GCE node
W20260808 14:56:50.605448 24466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:50.605867 24155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:50.606505 24155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:50.607715 24155 hybrid_clock.cc:648] HybridClock initialized: now 1786201010607631 us; error 63 us; skew 500 ppm
I20260808 14:56:50.607939 24155 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:50 dist-test-slave-z8x9 krb5kdc[23143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201010, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:50.610001 24155 init.cc:377] Logged in from keytab as oryx/127.12.73.188@KRBTEST.COM (short username oryx)
I20260808 14:56:50.611287 24155 webserver.cc:460] Webserver started at http://127.12.73.188:34189/ using document root <none> and password file <none>
I20260808 14:56:50.611694 24155 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:50.611817 24155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:50.614322 24155 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:56:50.616159 24474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:50.616597 24155 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:56:50.616725 24155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/wal
uuid: "a774ed42d1cc48eb9aea7c34edbf0b62"
format_stamp: "Formatted at 2026-08-08 14:56:50 on dist-test-slave-z8x9"
server_key: "5c6ea54b895595d48e2c80532d823183"
server_key_iv: "249b4a404befbb62fe5d12aafa9a8336"
server_key_version: "encryptionkey@0"
I20260808 14:56:50.616905 24155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:50.633793 24155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:50.637144 24155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:50.656556 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 23327
I20260808 14:56:50.685803 24155 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.188:33723
I20260808 14:56:50.685851 24545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.188:33723 every 8 connection(s)
I20260808 14:56:50.687018 24155 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
I20260808 14:56:50.692277 24547 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:56:50.694792 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:38439
--local_ip_for_outbound_sockets=127.12.73.129
--tserver_master_addrs=127.12.73.190:33041
--webserver_port=36935
--webserver_interface=127.12.73.129
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab
--principal=oryx/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:44131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.73.190:33041,127.12.73.189:35655
--tserver_master_addrs=127.12.73.190:33041,127.12.73.189:35655,127.12.73.188:33723 with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:56:50.695842 24547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: Bootstrap starting.
I20260808 14:56:50.712860 24547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:56:50.713549 24547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: Bootstrap complete.
I20260808 14:56:50.714833 24547 raft_consensus.cc:348] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } }
I20260808 14:56:50.715166 24547 raft_consensus.cc:729] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a774ed42d1cc48eb9aea7c34edbf0b62, State: Initialized, Role: LEARNER
I20260808 14:56:50.715508 24547 consensus_queue.cc:260] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } }
I20260808 14:56:50.717260 24557 sys_catalog.cc:455] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } } }
I20260808 14:56:50.717631 24547 sys_catalog.cc:564] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:50.717767 24557 sys_catalog.cc:458] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:56:50.738093 24570 catalog_manager.cc:1259] Loaded cluster ID: 94f6c4af6b0347cd904fd18469068e2a
I20260808 14:56:50.738322 24570 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: loading cluster ID for follower catalog manager: success
I20260808 14:56:50.742220 24570 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: acquiring CA information for follower catalog manager: success
I20260808 14:56:50.744668 24570 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:56:51.017768 24285 catalog_manager.cc:1259] Loaded cluster ID: 94f6c4af6b0347cd904fd18469068e2a
I20260808 14:56:51.017902 24285 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: loading cluster ID for follower catalog manager: success
I20260808 14:56:51.021592 24285 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: acquiring CA information for follower catalog manager: success
I20260808 14:56:51.024439 24285 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:56:51.043319 24572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.033895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:33723 (local address 127.0.0.1:54776)
0808 14:56:51.034832 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:51.034856 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:51.035027 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:51.035653 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:51.035660 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:51.035694 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:51.035912 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.035925 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.037965 (+ 2040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.037972 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.040246 (+ 2274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.040266 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.042350 (+ 2084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.042360 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.042558 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.042641 (+ 83us) client_negotiation.cc:769] Sending connection context
0808 14:56:51.042775 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 14:56:51.042945 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":790,"thread_start_us":647,"threads_started":1}
I20260808 14:56:51.044241 24573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.033989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54776 (local address 127.12.73.188:33723)
0808 14:56:51.034688 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:51.034694 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:51.034965 (+ 271us) server_negotiation.cc:407] Connection header received
0808 14:56:51.035212 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:51.035220 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:51.035336 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:51.035607 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:51.036064 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.037805 (+ 1741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.040419 (+ 2614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.041885 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.042034 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.042240 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:51.043653 (+ 1413us) server_negotiation.cc:299] Negotiation successful
0808 14:56:51.043837 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":349,"threads_started":1}
I20260808 14:56:51.045475 24511 raft_consensus.cc:1203] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 14:56:51.046633 24557 sys_catalog.cc:455] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80fc452b6d8e4c0a8a7147a0dc426fdc. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } } }
I20260808 14:56:51.046957 24557 sys_catalog.cc:458] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: This master's current role is: LEARNER
W20260808 14:56:51.068511 24554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:51.068784 24554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:51.068939 24554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:51.076189 24554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:51.076294 24554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:51.076532 24554 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:56:51.086799 24554 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:44131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab
--principal=oryx/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:38439
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=36935
--tserver_master_addrs=127.12.73.190:33041,127.12.73.189:35655,127.12.73.188:33723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:51.088178 24554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:51.089582 24554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:51.104076 24580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:51.104099 24585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:51.104151 24588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:51.105050 24554 server_base.cc:1034] running on GCE node
I20260808 14:56:51.105718 24554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:51.106695 24554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:51.107939 24554 hybrid_clock.cc:648] HybridClock initialized: now 1786201011107895 us; error 63 us; skew 500 ppm
I20260808 14:56:51.108305 24554 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:51 dist-test-slave-z8x9 krb5kdc[23143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201011, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:51.111678 24554 init.cc:377] Logged in from keytab as oryx/127.12.73.129@KRBTEST.COM (short username oryx)
I20260808 14:56:51.113605 24554 webserver.cc:460] Webserver started at http://127.12.73.129:36935/ using document root <none> and password file <none>
I20260808 14:56:51.114271 24554 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:51.114437 24554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:51.119858 24554 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:56:51.122612 24596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:51.123874 24554 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:51.124104 24554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "98cecc11e2664821a6edf4742860bb92"
format_stamp: "Formatted at 2026-08-08 14:56:47 on dist-test-slave-z8x9"
server_key: "90defc2c05106c7030683b39d58bc5fc"
server_key_iv: "5e1dd121a04f3ac83c7f9f3c2476f04e"
server_key_version: "encryptionkey@0"
I20260808 14:56:51.125054 24554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:51.161446 24554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:51.165793 24554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:51.166040 24554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:51.166960 24554 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:51.168260 24554 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:51.168349 24554 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:51.168437 24554 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:51.168493 24554 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:51.202083 24554 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:38439
I20260808 14:56:51.202122 24775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:38439 every 8 connection(s)
I20260808 14:56:51.203532 24554 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:56:51.209646 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 24554
I20260808 14:56:51.209975 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 23557
Aug 08 14:56:51 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.73.130@KRBTEST.COM
Aug 08 14:56:51 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201011, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.188@KRBTEST.COM
Aug 08 14:56:51 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201011, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.189@KRBTEST.COM
Aug 08 14:56:51 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201011, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:56:51.235584 24784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.206363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:59739 (local address 127.12.73.189:35655)
0808 14:56:51.207184 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:51.207188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:51.210048 (+ 2860us) server_negotiation.cc:407] Connection header received
0808 14:56:51.214690 (+ 4642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:51.214699 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:51.214795 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:51.214875 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:51.218209 (+ 3334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.219341 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.221307 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.221963 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.222059 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.228626 (+ 6567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:51.228634 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:51.228641 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:51.228687 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:51.232495 (+ 3808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.233324 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.233329 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.233333 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.233481 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.233960 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.233964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.233967 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.234350 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:51.234476 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:51.234997 (+ 521us) server_negotiation.cc:299] Negotiation successful
0808 14:56:51.235231 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":506,"threads_started":1}
I20260808 14:56:51.235869 24788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.208772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.129:51295)
0808 14:56:51.213686 (+ 4914us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:51.213701 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:51.213835 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:51.214393 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:51.214401 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:51.215675 (+ 1274us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:51.217200 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.217213 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.220465 (+ 3252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.220470 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.222049 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.222062 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.223183 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.223189 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.223395 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.224033 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:51.224056 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:51.227451 (+ 3395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:51.232322 (+ 4871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:51.232329 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:51.232336 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:51.232923 (+ 587us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:51.233402 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:51.233410 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:51.233415 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:51.233592 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:51.234337 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:51.234341 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:51.234493 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 14:56:51.234646 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 14:56:51.234951 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4804,"mutex_wait_us":74,"spinlock_wait_cycles":2432,"thread_start_us":4640,"threads_started":1}
I20260808 14:56:51.236469 24573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.206560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:50357 (local address 127.12.73.188:33723)
0808 14:56:51.206761 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:51.206767 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:51.210592 (+ 3825us) server_negotiation.cc:407] Connection header received
0808 14:56:51.213994 (+ 3402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:51.214001 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:51.214095 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:51.214191 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:51.216952 (+ 2761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.218021 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.220458 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.221162 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.221335 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.226879 (+ 5544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:51.226887 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:51.226891 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:51.226934 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:51.230546 (+ 3612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.231555 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.231562 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.231567 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.231727 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.232279 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.232284 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.232287 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.232668 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:51.232810 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:51.235829 (+ 3019us) server_negotiation.cc:299] Negotiation successful
0808 14:56:51.236089 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:56:51.236541 24786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.207030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:35655 (local address 127.12.73.129:59739)
0808 14:56:51.209843 (+ 2813us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:51.209889 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:51.214506 (+ 4617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:51.215202 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:51.215206 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:51.215759 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:51.216768 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.216791 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.219573 (+ 2782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.219579 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.221128 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.221141 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.222340 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.222344 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.222465 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.223004 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:51.223025 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:51.228328 (+ 5303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:51.232660 (+ 4332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:51.232665 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:51.232669 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:51.233163 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:51.233623 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:51.233630 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:51.233637 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:51.233827 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:51.234554 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:51.234559 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:51.234723 (+ 164us) client_negotiation.cc:769] Sending connection context
0808 14:56:51.235785 (+ 1062us) client_negotiation.cc:240] Negotiation successful
0808 14:56:51.236104 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2598,"mutex_wait_us":139,"spinlock_wait_cycles":97792,"thread_start_us":480,"threads_started":1}
I20260808 14:56:51.236763 24787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.207030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:33723 (local address 127.12.73.129:50357)
0808 14:56:51.208930 (+ 1900us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:51.210498 (+ 1568us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:51.213554 (+ 3056us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:51.214395 (+ 841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:51.214402 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:51.215675 (+ 1273us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:51.216767 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.216792 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.218157 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.218162 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.220301 (+ 2139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.220315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.221654 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.221663 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.221971 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.223011 (+ 1040us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:51.223039 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:51.226666 (+ 3627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:51.230727 (+ 4061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:51.230739 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:51.230756 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:51.231401 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:51.231880 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:51.231885 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:51.231890 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:51.232126 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:51.232911 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:51.232923 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:51.233414 (+ 491us) client_negotiation.cc:769] Sending connection context
0808 14:56:51.233781 (+ 367us) client_negotiation.cc:240] Negotiation successful
0808 14:56:51.234317 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1595,"mutex_wait_us":96,"spinlock_wait_cycles":23552,"thread_start_us":754,"threads_started":1}
I20260808 14:56:51.237865 24781 heartbeater.cc:347] Connected to a master server at 127.12.73.189:35655
I20260808 14:56:51.238140 24781 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:51.238322 24789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.209063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:51295 (local address 127.12.73.190:33041)
0808 14:56:51.209693 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:51.209700 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:51.213791 (+ 4091us) server_negotiation.cc:407] Connection header received
0808 14:56:51.213964 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:51.213969 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:51.214040 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:51.214151 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:51.217362 (+ 3211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.218461 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.222176 (+ 3715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.222971 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.223113 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.227682 (+ 4569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:51.227690 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:51.227696 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:51.227739 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:51.232147 (+ 4408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.233065 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.233071 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.233074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.233257 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.233733 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.233738 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.233741 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.234120 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:51.234249 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:51.236562 (+ 2313us) server_negotiation.cc:299] Negotiation successful
0808 14:56:51.236913 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":330,"threads_started":1}
I20260808 14:56:51.238790 24792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.211282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35826 (local address 127.12.73.130:37051)
0808 14:56:51.211964 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:51.211973 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:51.212005 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:56:51.212124 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:51.212134 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:51.212364 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:51.212512 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:51.214819 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.216527 (+ 1708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.218681 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.219288 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.219432 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.229003 (+ 9571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:51.229079 (+ 76us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:51.229099 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:51.229154 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:51.233453 (+ 4299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.234672 (+ 1219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.234682 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.234688 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.234860 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.235298 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.235303 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.235306 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.236512 (+ 1206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:51.237456 (+ 944us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:51.237776 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 14:56:51.238296 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":322,"threads_started":1}
I20260808 14:56:51.239158 24781 heartbeater.cc:511] Master 127.12.73.189:35655 requested a full tablet report, sending...
I20260808 14:56:51.237915 24776 heartbeater.cc:347] Connected to a master server at 127.12.73.188:33723
I20260808 14:56:51.240123 24776 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:51.240206 23752 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:51.240595 24776 heartbeater.cc:511] Master 127.12.73.188:33723 requested a full tablet report, sending...
I20260808 14:56:51.241482 24780 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33041
I20260808 14:56:51.241592 24780 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:51.241995 24780 heartbeater.cc:511] Master 127.12.73.190:33041 requested a full tablet report, sending...
I20260808 14:56:51.242599 24497 ts_manager.cc:194] Registered new tserver with Master: 98cecc11e2664821a6edf4742860bb92 (127.12.73.129:38439)
I20260808 14:56:51.242816 24215 ts_manager.cc:194] Registered new tserver with Master: 98cecc11e2664821a6edf4742860bb92 (127.12.73.129:38439)
I20260808 14:56:51.243835 23220 ts_manager.cc:194] Re-registered known tserver with Master: 98cecc11e2664821a6edf4742860bb92 (127.12.73.129:38439)
I20260808 14:56:51.244656 23220 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:51295
I20260808 14:56:51.334292 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 23557
I20260808 14:56:51.367472 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:37051
--local_ip_for_outbound_sockets=127.12.73.130
--tserver_master_addrs=127.12.73.190:33041
--webserver_port=43329
--webserver_interface=127.12.73.130
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab
--principal=oryx/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:44131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.73.190:33041,127.12.73.189:35655
--tserver_master_addrs=127.12.73.190:33041,127.12.73.189:35655,127.12.73.188:33723 with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:56:51.527273 24571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: NON_VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: true } } }
I20260808 14:56:51.527745 24571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:51.538283 24795 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc: attempting to promote NON_VOTER a774ed42d1cc48eb9aea7c34edbf0b62 to VOTER
I20260808 14:56:51.539196 24795 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } }
I20260808 14:56:51.542163 24229 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 FOLLOWER]: Refusing update from remote peer 80fc452b6d8e4c0a8a7147a0dc426fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 14:56:51.542187 24511 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 1 LEARNER]: Refusing update from remote peer 80fc452b6d8e4c0a8a7147a0dc426fdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 14:56:51.542984 24795 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 14:56:51.543448 24796 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 14:56:51.555840 24796 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, a774ed42d1cc48eb9aea7c34edbf0b62 (127.12.73.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } } }
I20260808 14:56:51.556808 24229 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, a774ed42d1cc48eb9aea7c34edbf0b62 (127.12.73.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } } }
I20260808 14:56:51.560552 24795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } } }
I20260808 14:56:51.560655 24571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } } }
I20260808 14:56:51.561012 24571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:51.561038 24795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:51.562510 24571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } } }
I20260808 14:56:51.562793 24571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:51.563248 24511 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, a774ed42d1cc48eb9aea7c34edbf0b62 (127.12.73.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } } }
I20260808 14:56:51.574061 24806 sys_catalog.cc:455] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } } }
I20260808 14:56:51.574434 24806 sys_catalog.cc:458] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:56:51.578051 24805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } } }
I20260808 14:56:51.578562 24805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:56:51.718598 24794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:51.718928 24794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:51.719111 24794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:51.726346 24794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:51.726490 24794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:51.726656 24794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:56:51.736379 24794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:44131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab
--principal=oryx/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:37051
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=43329
--tserver_master_addrs=127.12.73.190:33041,127.12.73.189:35655,127.12.73.188:33723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:51.737942 24794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:51.739599 24794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:51.753043 24813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:51.753090 24812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:51.753139 24815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:51.753978 24794 server_base.cc:1034] running on GCE node
I20260808 14:56:51.754522 24794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:51.755503 24794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:51.756726 24794 hybrid_clock.cc:648] HybridClock initialized: now 1786201011756686 us; error 32 us; skew 500 ppm
I20260808 14:56:51.757045 24794 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:51 dist-test-slave-z8x9 krb5kdc[23143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201011, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:51.760622 24794 init.cc:377] Logged in from keytab as oryx/127.12.73.130@KRBTEST.COM (short username oryx)
I20260808 14:56:51.762091 24794 webserver.cc:460] Webserver started at http://127.12.73.130:43329/ using document root <none> and password file <none>
I20260808 14:56:51.762719 24794 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:51.762841 24794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:51.768002 24794 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 14:56:51.770565 24823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:51.771828 24794 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:56:51.772014 24794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "a4e6d619d8a54a5ea710ecdbac8c014e"
format_stamp: "Formatted at 2026-08-08 14:56:48 on dist-test-slave-z8x9"
server_key: "3aea250268697cf25b5ef0ed66ca7fd9"
server_key_iv: "a6e11e8f710fa2e31b64329b3903234d"
server_key_version: "encryptionkey@0"
I20260808 14:56:51.772974 24794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:51.817065 24794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:51.821491 24794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:51.821796 24794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:51.822775 24794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:51.824180 24794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:51.824313 24794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:51.824438 24794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:51.824527 24794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:51.859725 24794 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:37051
I20260808 14:56:51.859812 25005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:37051 every 8 connection(s)
I20260808 14:56:51.861140 24794 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:56:51.862470 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 24794
I20260808 14:56:51.862779 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 23767
Aug 08 14:56:51 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.73.131@KRBTEST.COM
Aug 08 14:56:51 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201011, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
Aug 08 14:56:51 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201011, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.188@KRBTEST.COM
Aug 08 14:56:51 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201011, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.189@KRBTEST.COM
I20260808 14:56:51.912958 25012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.863668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46464 (local address 127.12.73.131:34879)
0808 14:56:51.882488 (+ 18820us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:51.882500 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:51.887505 (+ 5005us) server_negotiation.cc:407] Connection header received
0808 14:56:51.888083 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:51.888098 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:51.888444 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:51.888603 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:51.891590 (+ 2987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.893712 (+ 2122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.896207 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.897393 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.897501 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.904855 (+ 7354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:51.904874 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:51.904892 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:51.904946 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:51.909439 (+ 4493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.910309 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.910318 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.910321 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.910470 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.910962 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.910969 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.910974 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.911461 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:51.911743 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:51.912404 (+ 661us) server_negotiation.cc:299] Negotiation successful
0808 14:56:51.912623 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18584,"thread_start_us":18841,"threads_started":1}
I20260808 14:56:51.915302 23962 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:51.916277 25014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.864001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:33727 (local address 127.12.73.190:33041)
0808 14:56:51.878991 (+ 14990us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:51.879000 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:51.886015 (+ 7015us) server_negotiation.cc:407] Connection header received
0808 14:56:51.890871 (+ 4856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:51.890877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:51.890978 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:51.891076 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:51.893988 (+ 2912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.895463 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.900919 (+ 5456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.901676 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.901797 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.907494 (+ 5697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:51.907500 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:51.907504 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:51.907561 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:51.912085 (+ 4524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.913280 (+ 1195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.913288 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.913292 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.913448 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.914066 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.914071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.914074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.914441 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:51.914575 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:51.915594 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0808 14:56:51.915841 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14812,"thread_start_us":14687,"threads_started":1}
I20260808 14:56:51.918179 25018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.864735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:33723 (local address 127.12.73.130:56783)
0808 14:56:51.890405 (+ 25670us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:51.890419 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:51.890565 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:51.895856 (+ 5291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:51.895860 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:51.896597 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:51.897001 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.897016 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.899078 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.899086 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.901262 (+ 2176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.901281 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.902881 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.902890 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.903139 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.903850 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:51.903872 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:51.907305 (+ 3433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:51.913104 (+ 5799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:51.913111 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:51.913117 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:51.914123 (+ 1006us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:51.914560 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:51.914565 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:51.914568 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:51.914715 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:51.915477 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:51.915482 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:51.915623 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 14:56:51.915773 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 14:56:51.916269 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25516,"thread_start_us":20550,"threads_started":1}
I20260808 14:56:51.918200 25020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.864740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.130:33727)
0808 14:56:51.885827 (+ 21087us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:51.885884 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:51.889350 (+ 3466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:51.891680 (+ 2330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:51.891696 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:51.892718 (+ 1022us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:51.893737 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.893768 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.895687 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.895692 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.900711 (+ 5019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.900738 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.902157 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.902166 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.902481 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.903477 (+ 996us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:51.903525 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:51.907192 (+ 3667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:51.912290 (+ 5098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:51.912299 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:51.912314 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:51.912937 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:51.913614 (+ 677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:51.913622 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:51.913630 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:51.913924 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:51.914644 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:51.914651 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:51.915153 (+ 502us) client_negotiation.cc:769] Sending connection context
0808 14:56:51.916470 (+ 1317us) client_negotiation.cc:240] Negotiation successful
0808 14:56:51.916761 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20781,"thread_start_us":25338,"threads_started":1}
I20260808 14:56:51.920199 25017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.864155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:56783 (local address 127.12.73.188:33723)
0808 14:56:51.890057 (+ 25902us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:51.890063 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:51.890517 (+ 454us) server_negotiation.cc:407] Connection header received
0808 14:56:51.895617 (+ 5100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:51.895624 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:51.895723 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:51.895847 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:51.897315 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.898860 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.901486 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.902409 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.902559 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.907534 (+ 4975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:51.907540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:51.907544 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:51.907583 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:51.912294 (+ 4711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.914260 (+ 1966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.914266 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.914269 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.914416 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.914864 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.914869 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.914872 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.915226 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:51.919438 (+ 4212us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:51.919605 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 14:56:51.919846 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25774,"thread_start_us":25632,"threads_started":1}
I20260808 14:56:51.920244 25007 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33041
I20260808 14:56:51.920567 25007 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:51.921573 25007 heartbeater.cc:511] Master 127.12.73.190:33041 requested a full tablet report, sending...
I20260808 14:56:51.922366 25006 heartbeater.cc:347] Connected to a master server at 127.12.73.188:33723
I20260808 14:56:51.922500 25006 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:51.922940 25006 heartbeater.cc:511] Master 127.12.73.188:33723 requested a full tablet report, sending...
I20260808 14:56:51.923326 25024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.890774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:35655 (local address 127.12.73.130:49137)
0808 14:56:51.897580 (+ 6806us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:51.897606 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:51.897717 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:51.904169 (+ 6452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:51.904174 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:51.904803 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:51.905360 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.905376 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.906913 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.906921 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.908602 (+ 1681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:51.908620 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.910120 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.910132 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:51.910336 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.910881 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:51.910905 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:51.913927 (+ 3022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:51.919386 (+ 5459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:51.919394 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:51.919400 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:51.920090 (+ 690us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:51.921282 (+ 1192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:51.921286 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:51.921290 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:51.921483 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:51.922256 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:51.922263 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:51.922450 (+ 187us) client_negotiation.cc:769] Sending connection context
0808 14:56:51.922602 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 14:56:51.922909 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6695,"thread_start_us":7022,"threads_started":1}
I20260808 14:56:51.923425 23220 ts_manager.cc:194] Re-registered known tserver with Master: a4e6d619d8a54a5ea710ecdbac8c014e (127.12.73.130:37051)
I20260808 14:56:51.924160 24497 ts_manager.cc:194] Registered new tserver with Master: a4e6d619d8a54a5ea710ecdbac8c014e (127.12.73.130:37051)
I20260808 14:56:51.924252 25023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:51.890900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:49137 (local address 127.12.73.189:35655)
0808 14:56:51.903698 (+ 12798us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:51.903704 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:51.903724 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:56:51.903793 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:51.903798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:51.903886 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:51.905224 (+ 1338us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:51.905564 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.906712 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.909264 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:51.909912 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:51.910054 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:51.914295 (+ 4241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:51.914301 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:51.914305 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:51.914351 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:51.919195 (+ 4844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.920263 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.920271 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.920277 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.921117 (+ 840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:51.921619 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:51.921627 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:51.921632 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:51.922057 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:51.922218 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:51.923648 (+ 1430us) server_negotiation.cc:299] Negotiation successful
0808 14:56:51.923871 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12638,"thread_start_us":13094,"threads_started":1}
I20260808 14:56:51.924973 23220 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:33727
I20260808 14:56:51.926088 25008 heartbeater.cc:347] Connected to a master server at 127.12.73.189:35655
I20260808 14:56:51.926242 25008 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:51.926724 25008 heartbeater.cc:511] Master 127.12.73.189:35655 requested a full tablet report, sending...
I20260808 14:56:51.927773 24215 ts_manager.cc:194] Registered new tserver with Master: a4e6d619d8a54a5ea710ecdbac8c014e (127.12.73.130:37051)
I20260808 14:56:52.013550 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 23767
I20260808 14:56:52.039415 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:34879
--local_ip_for_outbound_sockets=127.12.73.131
--tserver_master_addrs=127.12.73.190:33041
--webserver_port=37081
--webserver_interface=127.12.73.131
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab
--principal=oryx/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:44131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.73.190:33041,127.12.73.189:35655
--tserver_master_addrs=127.12.73.190:33041,127.12.73.189:35655,127.12.73.188:33723 with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:56:52.248025 24780 heartbeater.cc:503] Master 127.12.73.190:33041 was elected leader, sending a full tablet report...
W20260808 14:56:52.390836 25028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:52.391170 25028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:52.391455 25028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:52.399520 25028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:52.399690 25028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:52.399883 25028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:56:52.410252 25028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:44131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab
--principal=oryx/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:34879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=37081
--tserver_master_addrs=127.12.73.190:33041,127.12.73.189:35655,127.12.73.188:33723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:52.411718 25028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:52.413048 25028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:52.426615 25037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:52.426649 25043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:52.426709 25036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:52.427999 25028 server_base.cc:1034] running on GCE node
I20260808 14:56:52.428592 25028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:52.429718 25028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:52.430949 25028 hybrid_clock.cc:648] HybridClock initialized: now 1786201012430873 us; error 79 us; skew 500 ppm
I20260808 14:56:52.431267 25028 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:52 dist-test-slave-z8x9 krb5kdc[23143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201012, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:52.434449 25028 init.cc:377] Logged in from keytab as oryx/127.12.73.131@KRBTEST.COM (short username oryx)
I20260808 14:56:52.435771 25028 webserver.cc:460] Webserver started at http://127.12.73.131:37081/ using document root <none> and password file <none>
I20260808 14:56:52.436373 25028 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:52.436489 25028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:52.441644 25028 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:52.444243 25056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:52.445559 25028 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:52.445708 25028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "07f82f449cc24186af5e93b4be94a7cb"
format_stamp: "Formatted at 2026-08-08 14:56:49 on dist-test-slave-z8x9"
server_key: "ffd5270ede159dab1425a73607e61cbb"
server_key_iv: "4fd1f23b703bd1d3b5cc30abb5451d33"
server_key_version: "encryptionkey@0"
I20260808 14:56:52.446682 25028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:52.461078 25028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:52.464792 25028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:52.465015 25028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:52.465946 25028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:56:52.467401 25028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:52.467520 25028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:52.467600 25028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:52.467679 25028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:52.503170 25028 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:34879
I20260808 14:56:52.503266 25240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:34879 every 8 connection(s)
I20260808 14:56:52.504603 25028 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:56:52.515067 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 25028
Aug 08 14:56:52 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201012, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
Aug 08 14:56:52 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201012, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.189@KRBTEST.COM
I20260808 14:56:52.535559 25256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.510757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.131:54993)
0808 14:56:52.511365 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:52.511390 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:52.512338 (+ 948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:52.513027 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:52.513032 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:52.513956 (+ 924us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:52.514506 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.514519 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.515962 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.515971 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.517782 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.517791 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.519127 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.519133 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.519579 (+ 446us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.520680 (+ 1101us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:52.520714 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:52.524442 (+ 3728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:52.529742 (+ 5300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:52.529755 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:52.529778 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:52.530519 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:52.531022 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:52.531030 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:52.531036 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:52.531340 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:52.532252 (+ 912us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:52.532263 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:52.532772 (+ 509us) client_negotiation.cc:769] Sending connection context
0808 14:56:52.533125 (+ 353us) client_negotiation.cc:240] Negotiation successful
0808 14:56:52.533822 (+ 697us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":187,"spinlock_wait_cycles":3840,"thread_start_us":342,"threads_started":1}
I20260808 14:56:52.537027 25257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.510936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:54993 (local address 127.12.73.190:33041)
0808 14:56:52.511597 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:52.511601 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:52.511617 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:56:52.512663 (+ 1046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:52.512668 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:52.512746 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:52.512847 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:52.514667 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.515794 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.517964 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.518617 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.520071 (+ 1454us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.524761 (+ 4690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:52.524770 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:52.524778 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:52.524828 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:52.529549 (+ 4721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:52.530692 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:52.530697 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:52.530700 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:52.530873 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:52.531504 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:52.531510 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:52.531516 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:52.531985 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:52.532149 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:52.536172 (+ 4023us) server_negotiation.cc:299] Negotiation successful
0808 14:56:52.536482 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":442,"threads_started":1}
Aug 08 14:56:52 dist-test-slave-z8x9 krb5kdc[23143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201012, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.188@KRBTEST.COM
I20260808 14:56:52.544130 25254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.508180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:35655 (local address 127.12.73.131:49941)
0808 14:56:52.510004 (+ 1824us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:52.510046 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:52.512319 (+ 2273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:52.513010 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:52.513017 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:52.513645 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:52.514212 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.514228 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.519062 (+ 4834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.519070 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.521726 (+ 2656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.521742 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.522711 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.522717 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.522890 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.523498 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:52.523526 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:52.526993 (+ 3467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:52.538598 (+ 11605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:52.538605 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:52.538608 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:52.539117 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:52.541346 (+ 2229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:52.541352 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:52.541356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:52.541527 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:52.542738 (+ 1211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:52.542747 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:52.542947 (+ 200us) client_negotiation.cc:769] Sending connection context
0808 14:56:52.543113 (+ 166us) client_negotiation.cc:240] Negotiation successful
0808 14:56:52.543551 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1560,"thread_start_us":1996,"threads_started":1}
I20260808 14:56:52.545804 25249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.507494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:49941 (local address 127.12.73.189:35655)
0808 14:56:52.508132 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:52.508142 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:52.510157 (+ 2015us) server_negotiation.cc:407] Connection header received
0808 14:56:52.512568 (+ 2411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:52.512574 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:52.512659 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:52.512774 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:52.514385 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.518804 (+ 4419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.521946 (+ 3142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.522518 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.522671 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.527376 (+ 4705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:52.527386 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:52.527394 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:52.527448 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:52.538115 (+ 10667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:52.540970 (+ 2855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:52.540976 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:52.540981 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:52.541153 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:52.542042 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:52.542050 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:52.542054 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:52.542456 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:52.542643 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:52.545140 (+ 2497us) server_negotiation.cc:299] Negotiation successful
0808 14:56:52.545418 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":446,"threads_started":1}
I20260808 14:56:52.547497 25246 heartbeater.cc:347] Connected to a master server at 127.12.73.189:35655
I20260808 14:56:52.547950 25246 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:52.549189 25246 heartbeater.cc:511] Master 127.12.73.189:35655 requested a full tablet report, sending...
I20260808 14:56:52.550388 25250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.507820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:57915 (local address 127.12.73.188:33723)
0808 14:56:52.508940 (+ 1120us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:52.508948 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:52.510485 (+ 1537us) server_negotiation.cc:407] Connection header received
0808 14:56:52.512664 (+ 2179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:52.512670 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:52.512752 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:52.512848 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:52.514644 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.515450 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.517937 (+ 2487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.518615 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.518723 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.540433 (+ 21710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:52.540443 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:52.540451 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:52.540507 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:52.545722 (+ 5215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:52.546995 (+ 1273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:52.547004 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:52.547010 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:52.547218 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:52.547735 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:52.547743 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:52.547749 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:52.548228 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:52.548392 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:52.549601 (+ 1209us) server_negotiation.cc:299] Negotiation successful
0808 14:56:52.549885 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":981,"thread_start_us":880,"threads_started":1}
I20260808 14:56:52.551301 25253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.508460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:33723 (local address 127.12.73.131:57915)
0808 14:56:52.510007 (+ 1547us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:52.510043 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:52.512338 (+ 2295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:52.513027 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:52.513032 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:52.513956 (+ 924us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:52.514443 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.514461 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.515597 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.515602 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.517769 (+ 2167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.517784 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.519100 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.519113 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.519577 (+ 464us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.521373 (+ 1796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:52.521394 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:52.540167 (+ 18773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:52.546152 (+ 5985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:52.546160 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:52.546167 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:52.546811 (+ 644us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:52.547373 (+ 562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:52.547380 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:52.547387 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:52.547592 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:52.548470 (+ 878us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:52.548478 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:52.548687 (+ 209us) client_negotiation.cc:769] Sending connection context
0808 14:56:52.548867 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 14:56:52.549269 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1415,"mutex_wait_us":170,"spinlock_wait_cycles":36608,"thread_start_us":1086,"threads_started":1}
I20260808 14:56:52.552244 25242 heartbeater.cc:347] Connected to a master server at 127.12.73.188:33723
I20260808 14:56:52.552398 25242 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:52.552380 24215 ts_manager.cc:194] Registered new tserver with Master: 07f82f449cc24186af5e93b4be94a7cb (127.12.73.131:34879)
I20260808 14:56:52.552827 25242 heartbeater.cc:511] Master 127.12.73.188:33723 requested a full tablet report, sending...
I20260808 14:56:52.554154 24497 ts_manager.cc:194] Registered new tserver with Master: 07f82f449cc24186af5e93b4be94a7cb (127.12.73.131:34879)
I20260808 14:56:52.555768 25245 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33041
I20260808 14:56:52.555909 25245 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:52.556347 25245 heartbeater.cc:511] Master 127.12.73.190:33041 requested a full tablet report, sending...
I20260808 14:56:52.558409 23220 ts_manager.cc:194] Re-registered known tserver with Master: 07f82f449cc24186af5e93b4be94a7cb (127.12.73.131:34879)
I20260808 14:56:52.559322 23220 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:54993
I20260808 14:56:52.569485 25267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.523635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53554 (local address 127.12.73.190:33041)
0808 14:56:52.536976 (+ 13341us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:52.536983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:52.537003 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:56:52.537063 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:52.537068 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:52.537157 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:52.540834 (+ 3677us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:52.541018 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.542276 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.546128 (+ 3852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.554651 (+ 8523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.563040 (+ 8389us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.563260 (+ 220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:52.563264 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:52.563267 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:52.563296 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:52.566159 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:52.567052 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:52.567059 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:52.567067 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:52.567183 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:52.567583 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:52.567588 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:52.567591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:52.568011 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:52.568245 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:52.568799 (+ 554us) server_negotiation.cc:299] Negotiation successful
0808 14:56:52.568996 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13210,"thread_start_us":13641,"threads_started":1}
I20260808 14:56:52.574941 25249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.556566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38208 (local address 127.12.73.189:35655)
0808 14:56:52.556707 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:52.556712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:52.557553 (+ 841us) server_negotiation.cc:407] Connection header received
0808 14:56:52.557775 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:52.557781 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:52.557871 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:52.557940 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:52.560541 (+ 2601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.561644 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.563624 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.564286 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.564393 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.567928 (+ 3535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:52.567935 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:52.567943 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:52.567990 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:52.571680 (+ 3690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:52.572564 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:52.572569 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:52.572572 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:52.572721 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:52.573255 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:52.573260 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:52.573263 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:52.573624 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:52.573871 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:52.574350 (+ 479us) server_negotiation.cc:299] Negotiation successful
0808 14:56:52.574570 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:56:52.579401 25250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.523745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49232 (local address 127.12.73.188:33723)
0808 14:56:52.550787 (+ 27042us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:52.550795 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:52.551581 (+ 786us) server_negotiation.cc:407] Connection header received
0808 14:56:52.552228 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:52.552233 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:52.552345 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:52.552416 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:52.557419 (+ 5003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.558528 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.561498 (+ 2970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.563190 (+ 1692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.563288 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.567026 (+ 3738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:52.567033 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:52.567039 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:52.567082 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:52.570792 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:52.571786 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:52.571791 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:52.571794 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:52.571942 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:52.572421 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:52.572426 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:52.572430 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:52.572868 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:52.573143 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:52.573568 (+ 425us) server_negotiation.cc:299] Negotiation successful
0808 14:56:52.574010 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26907,"thread_start_us":27044,"threads_started":1}
I20260808 14:56:52.574738 23220 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53554:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:56:52.582664 23220 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:52.635111 25296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.601621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:34879 (local address 127.0.0.1:47896)
0808 14:56:52.623037 (+ 21416us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:52.623066 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:52.623194 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:52.623926 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:52.623934 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:52.623966 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:52.624544 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.624560 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.627932 (+ 3372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.627941 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.631164 (+ 3223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.631186 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.633906 (+ 2720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.633916 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.634163 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.634222 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 14:56:52.634310 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:56:52.634513 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21282,"mutex_wait_us":106,"thread_start_us":21774,"threads_started":1}
I20260808 14:56:52.636813 25297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.602976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50860 (local address 127.12.73.129:38439)
0808 14:56:52.621644 (+ 18668us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:52.621653 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:52.625352 (+ 3699us) server_negotiation.cc:407] Connection header received
0808 14:56:52.625706 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:52.625719 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:52.625993 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:52.626262 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:52.627426 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.629388 (+ 1962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.632890 (+ 3502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.634883 (+ 1993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.635025 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.635311 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:52.636128 (+ 817us) server_negotiation.cc:299] Negotiation successful
0808 14:56:52.636384 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18480,"thread_start_us":18378,"threads_started":1}
I20260808 14:56:52.637785 25293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.602566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38439 (local address 127.0.0.1:50860)
0808 14:56:52.623650 (+ 21084us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:52.625219 (+ 1569us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:52.625489 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:52.626635 (+ 1146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:52.626643 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:52.626678 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:52.627110 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.627124 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.629570 (+ 2446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.629574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.632667 (+ 3093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.632687 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.635559 (+ 2872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.635568 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.635821 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.635869 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:56:52.637202 (+ 1333us) client_negotiation.cc:240] Negotiation successful
0808 14:56:52.637329 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20959,"mutex_wait_us":6,"thread_start_us":20211,"threads_started":1}
I20260808 14:56:52.639720 25295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.601931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47896 (local address 127.12.73.131:34879)
0808 14:56:52.613319 (+ 11388us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:52.613332 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:52.623204 (+ 9872us) server_negotiation.cc:407] Connection header received
0808 14:56:52.623353 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:52.623371 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:52.623684 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:52.624835 (+ 1151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:52.625266 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.627720 (+ 2454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.631465 (+ 3745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.633568 (+ 2103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.636217 (+ 2649us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.636523 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:52.636607 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 14:56:52.636835 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11169,"thread_start_us":11409,"threads_started":1}
I20260808 14:56:52.641887 24670 tablet_service.cc:1467] Processing CreateTablet for tablet aac972569dd04dda972c11d4fca6fbff (DEFAULT_TABLE table=test-table [id=1f9ab0ad75bd4c0a874e2433fa1f2190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:52.643141 24670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aac972569dd04dda972c11d4fca6fbff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:52.644537 25141 tablet_service.cc:1467] Processing CreateTablet for tablet aac972569dd04dda972c11d4fca6fbff (DEFAULT_TABLE table=test-table [id=1f9ab0ad75bd4c0a874e2433fa1f2190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:52.645975 25141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aac972569dd04dda972c11d4fca6fbff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:52.647249 25296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.623780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:37051 (local address 127.0.0.1:45164)
0808 14:56:52.635864 (+ 12084us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:52.635887 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:52.636010 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:52.640824 (+ 4814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:52.640833 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:52.640873 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:52.641064 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.641079 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.642857 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.642862 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.644667 (+ 1805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.644696 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.646527 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.646532 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.646704 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.646736 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 14:56:52.646813 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:56:52.646958 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11955,"thread_start_us":17132,"threads_started":1}
I20260808 14:56:52.648233 25299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.623993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45164 (local address 127.12.73.130:37051)
0808 14:56:52.637699 (+ 13706us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:52.637709 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:52.637744 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:56:52.637863 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:52.640016 (+ 2153us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:52.640320 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:52.641265 (+ 945us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:52.641446 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.642677 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.644900 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.646329 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.647501 (+ 1172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.647707 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:52.647789 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 14:56:52.647956 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13476,"thread_start_us":14158,"threads_started":1}
I20260808 14:56:52.651984 24899 tablet_service.cc:1467] Processing CreateTablet for tablet aac972569dd04dda972c11d4fca6fbff (DEFAULT_TABLE table=test-table [id=1f9ab0ad75bd4c0a874e2433fa1f2190]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:52.653322 24899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aac972569dd04dda972c11d4fca6fbff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:52.658742 25301 tablet_bootstrap.cc:492] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92: Bootstrap starting.
I20260808 14:56:52.666376 25303 tablet_bootstrap.cc:492] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb: Bootstrap starting.
I20260808 14:56:52.668634 25301 tablet_bootstrap.cc:654] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:52.670063 25303 tablet_bootstrap.cc:654] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:52.670091 25301 log.cc:824] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:52.671530 25303 log.cc:824] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:52.671645 25304 tablet_bootstrap.cc:492] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e: Bootstrap starting.
I20260808 14:56:52.675325 25304 tablet_bootstrap.cc:654] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:52.675360 25303 tablet_bootstrap.cc:492] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb: No bootstrap required, opened a new log
I20260808 14:56:52.675372 25301 tablet_bootstrap.cc:492] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92: No bootstrap required, opened a new log
I20260808 14:56:52.675608 25303 ts_tablet_manager.cc:1397] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.005s
I20260808 14:56:52.675662 25301 ts_tablet_manager.cc:1397] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.000s
I20260808 14:56:52.676608 25304 log.cc:824] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:56:52.681382 25304 tablet_bootstrap.cc:492] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e: No bootstrap required, opened a new log
I20260808 14:56:52.681691 25304 ts_tablet_manager.cc:1397] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 14:56:52.683379 25303 raft_consensus.cc:348] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:52.683746 25303 raft_consensus.cc:374] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:52.683879 25303 raft_consensus.cc:729] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f82f449cc24186af5e93b4be94a7cb, State: Initialized, Role: FOLLOWER
I20260808 14:56:52.684484 25303 consensus_queue.cc:260] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:52.686225 25301 raft_consensus.cc:348] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:52.686708 25301 raft_consensus.cc:374] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:52.686856 25301 raft_consensus.cc:729] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98cecc11e2664821a6edf4742860bb92, State: Initialized, Role: FOLLOWER
I20260808 14:56:52.687574 25301 consensus_queue.cc:260] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:52.693905 25304 raft_consensus.cc:348] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:52.694463 25304 raft_consensus.cc:374] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:52.694609 25304 raft_consensus.cc:729] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4e6d619d8a54a5ea710ecdbac8c014e, State: Initialized, Role: FOLLOWER
I20260808 14:56:52.695513 25301 ts_tablet_manager.cc:1428] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92: Time spent starting tablet: real 0.020s user 0.012s sys 0.006s
I20260808 14:56:52.695395 25304 consensus_queue.cc:260] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:52.703836 25245 heartbeater.cc:503] Master 127.12.73.190:33041 was elected leader, sending a full tablet report...
I20260808 14:56:52.705618 25303 ts_tablet_manager.cc:1428] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb: Time spent starting tablet: real 0.030s user 0.008s sys 0.015s
W20260808 14:56:52.707520 24782 tablet.cc:2369] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:56:52.709358 25007 heartbeater.cc:503] Master 127.12.73.190:33041 was elected leader, sending a full tablet report...
I20260808 14:56:52.709549 25304 ts_tablet_manager.cc:1428] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e: Time spent starting tablet: real 0.028s user 0.019s sys 0.005s
W20260808 14:56:52.759729 25248 tablet.cc:2369] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:56:52.885751 25022 tablet.cc:2369] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:56:52.911191 25314 raft_consensus.cc:482] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:52.911484 25314 raft_consensus.cc:504] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:52.913275 25314 leader_election.cc:288] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f82f449cc24186af5e93b4be94a7cb (127.12.73.131:34879), a4e6d619d8a54a5ea710ecdbac8c014e (127.12.73.130:37051)
I20260808 14:56:52.920657 25295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.913633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:52463 (local address 127.12.73.131:34879)
0808 14:56:52.913819 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:52.913824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:52.914345 (+ 521us) server_negotiation.cc:407] Connection header received
0808 14:56:52.914710 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:52.914716 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:52.914802 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:52.914858 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:52.915625 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.916507 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.918845 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.919703 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.919825 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.919886 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:52.920275 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 14:56:52.920415 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:56:52.920744 25316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.913533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:34879 (local address 127.12.73.129:52463)
0808 14:56:52.914230 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:52.914250 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:52.914499 (+ 249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:52.915122 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:52.915129 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:52.915170 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:52.915475 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.915487 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.916668 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.916675 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.918679 (+ 2004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.918691 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.919925 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.919931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.920101 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.920136 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:56:52.920232 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 14:56:52.920322 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"mutex_wait_us":2,"thread_start_us":340,"threads_started":1}
I20260808 14:56:52.921043 25317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.914286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:37051 (local address 127.12.73.129:33491)
0808 14:56:52.914836 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:52.914850 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:52.915014 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:52.915377 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:52.915382 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:52.915415 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:52.915840 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.915855 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.917075 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.917079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.918909 (+ 1830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:52.918924 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.920128 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.920133 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:52.920293 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.920325 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 14:56:52.920424 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:56:52.920546 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"mutex_wait_us":31,"thread_start_us":304,"threads_started":1}
I20260808 14:56:52.921072 25299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.914407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:33491 (local address 127.12.73.130:37051)
0808 14:56:52.914642 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:52.914647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:52.914948 (+ 301us) server_negotiation.cc:407] Connection header received
0808 14:56:52.915173 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:52.915178 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:52.915248 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:52.915346 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:52.916009 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.916940 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.919048 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.919918 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.920070 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.920137 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:52.920474 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 14:56:52.920604 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 14:56:52.921883 25174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aac972569dd04dda972c11d4fca6fbff" candidate_uuid: "98cecc11e2664821a6edf4742860bb92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f82f449cc24186af5e93b4be94a7cb" is_pre_election: true
I20260808 14:56:52.922114 24932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aac972569dd04dda972c11d4fca6fbff" candidate_uuid: "98cecc11e2664821a6edf4742860bb92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" is_pre_election: true
I20260808 14:56:52.922405 25174 raft_consensus.cc:2454] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98cecc11e2664821a6edf4742860bb92 in term 0.
I20260808 14:56:52.922652 24932 raft_consensus.cc:2454] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98cecc11e2664821a6edf4742860bb92 in term 0.
I20260808 14:56:52.923094 24599 leader_election.cc:302] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f82f449cc24186af5e93b4be94a7cb, 98cecc11e2664821a6edf4742860bb92; no voters:
I20260808 14:56:52.923486 25314 raft_consensus.cc:2781] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:52.923643 25314 raft_consensus.cc:482] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:52.923741 25314 raft_consensus.cc:3037] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:52.926115 25314 raft_consensus.cc:504] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:52.926643 25314 leader_election.cc:288] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [CANDIDATE]: Term 1 election: Requested vote from peers 07f82f449cc24186af5e93b4be94a7cb (127.12.73.131:34879), a4e6d619d8a54a5ea710ecdbac8c014e (127.12.73.130:37051)
I20260808 14:56:52.927142 25174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aac972569dd04dda972c11d4fca6fbff" candidate_uuid: "98cecc11e2664821a6edf4742860bb92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f82f449cc24186af5e93b4be94a7cb"
I20260808 14:56:52.927249 24932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aac972569dd04dda972c11d4fca6fbff" candidate_uuid: "98cecc11e2664821a6edf4742860bb92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e"
I20260808 14:56:52.927368 25174 raft_consensus.cc:3037] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:52.927466 24932 raft_consensus.cc:3037] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:52.930732 25174 raft_consensus.cc:2454] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98cecc11e2664821a6edf4742860bb92 in term 1.
I20260808 14:56:52.930732 24932 raft_consensus.cc:2454] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98cecc11e2664821a6edf4742860bb92 in term 1.
I20260808 14:56:52.931129 24599 leader_election.cc:302] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98cecc11e2664821a6edf4742860bb92, a4e6d619d8a54a5ea710ecdbac8c014e; no voters:
I20260808 14:56:52.931427 25314 raft_consensus.cc:2781] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:52.931844 25314 raft_consensus.cc:686] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 1 LEADER]: Becoming Leader. State: Replica: 98cecc11e2664821a6edf4742860bb92, State: Running, Role: LEADER
I20260808 14:56:52.932612 25314 consensus_queue.cc:237] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:52.937783 23220 catalog_manager.cc:5495] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98cecc11e2664821a6edf4742860bb92 (127.12.73.129). New cstate: current_term: 1 leader_uuid: "98cecc11e2664821a6edf4742860bb92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } health_report { overall_health: HEALTHY } } }
I20260808 14:56:52.974558 25297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:52.969369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50862 (local address 127.12.73.129:38439)
0808 14:56:52.969549 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:52.969553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:52.969569 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:56:52.969656 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:52.969659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:52.969747 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:52.969878 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:52.970199 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.970901 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.972408 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:52.972811 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:52.972959 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:52.973491 (+ 532us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:52.974005 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:52.974128 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:52.974247 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 14:56:52.974311 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:56:52.983991 25174 raft_consensus.cc:1261] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb [term 1 FOLLOWER]: Refusing update from remote peer 98cecc11e2664821a6edf4742860bb92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:52.983991 24932 raft_consensus.cc:1261] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e [term 1 FOLLOWER]: Refusing update from remote peer 98cecc11e2664821a6edf4742860bb92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:52.984990 25314 consensus_queue.cc:1035] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:52.985404 25318 consensus_queue.cc:1035] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:52.997561 25324 mvcc.cc:205] Tried to move back new op lower bound from 7316279349171253248 to 7316279348975730688. Current Snapshot: MvccSnapshot[applied={T|T < 7316279349171253248}]
I20260808 14:56:53.014091 23220 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:53.014359 23220 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:53.022094 23220 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 80fc452b6d8e4c0a8a7147a0dc426fdc: Sending DeleteTablet for 3 replicas of tablet aac972569dd04dda972c11d4fca6fbff
I20260808 14:56:53.023245 25141 tablet_service.cc:1514] Processing DeleteTablet for tablet aac972569dd04dda972c11d4fca6fbff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:53 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:47896
I20260808 14:56:53.023245 24899 tablet_service.cc:1514] Processing DeleteTablet for tablet aac972569dd04dda972c11d4fca6fbff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:53 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:45164
I20260808 14:56:53.023329 24670 tablet_service.cc:1514] Processing DeleteTablet for tablet aac972569dd04dda972c11d4fca6fbff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:53 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:50860
I20260808 14:56:53.041656 25341 tablet_replica.cc:330] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92: stopping tablet replica
I20260808 14:56:53.042073 25341 raft_consensus.cc:2229] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:56:53.042634 25341 raft_consensus.cc:2258] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:53.044346 25341 ts_tablet_manager.cc:1905] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:53.048466 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 23165
I20260808 14:56:53.049620 23272 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:53.052505 25336 tablet_replica.cc:330] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb: stopping tablet replica
I20260808 14:56:53.053530 25336 raft_consensus.cc:2229] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:53.057214 25341 ts_tablet_manager.cc:1918] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:53.058641 25336 raft_consensus.cc:2258] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:53.058907 25341 log.cc:1196] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/aac972569dd04dda972c11d4fca6fbff
I20260808 14:56:53.059897 25341 ts_tablet_manager.cc:1939] T aac972569dd04dda972c11d4fca6fbff P 98cecc11e2664821a6edf4742860bb92: Deleting consensus metadata
I20260808 14:56:53.061635 25336 ts_tablet_manager.cc:1905] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:53.069443 25338 tablet_replica.cc:330] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e: stopping tablet replica
I20260808 14:56:53.069975 25338 raft_consensus.cc:2229] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:53.070443 25338 raft_consensus.cc:2258] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:53.075537 25338 ts_tablet_manager.cc:1905] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:53.081552 25338 ts_tablet_manager.cc:1918] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:53.081815 25338 log.cc:1196] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/aac972569dd04dda972c11d4fca6fbff
I20260808 14:56:53.082525 25338 ts_tablet_manager.cc:1939] T aac972569dd04dda972c11d4fca6fbff P a4e6d619d8a54a5ea710ecdbac8c014e: Deleting consensus metadata
I20260808 14:56:53.085843 25249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:53.031864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38210 (local address 127.12.73.189:35655)
0808 14:56:53.032073 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:53.032083 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:53.047113 (+ 15030us) server_negotiation.cc:407] Connection header received
0808 14:56:53.048273 (+ 1160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:53.048280 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:53.048375 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:53.048458 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:53.053879 (+ 5421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:53.055378 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:53.067646 (+ 12268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:53.068613 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:53.068752 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:53.074137 (+ 5385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:53.074144 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:53.074149 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:53.074195 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:53.077929 (+ 3734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:53.082133 (+ 4204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:53.082140 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:53.082143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:53.082318 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:53.082832 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:53.082841 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:53.082847 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:53.083288 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:53.083565 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:53.085106 (+ 1541us) server_negotiation.cc:299] Negotiation successful
0808 14:56:53.085423 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:56:53.089444 25336 ts_tablet_manager.cc:1918] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:53.089723 25336 log.cc:1196] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/aac972569dd04dda972c11d4fca6fbff
I20260808 14:56:53.090343 25336 ts_tablet_manager.cc:1939] T aac972569dd04dda972c11d4fca6fbff P 07f82f449cc24186af5e93b4be94a7cb: Deleting consensus metadata
I20260808 14:56:53.100565 25250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:53.047723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49242 (local address 127.12.73.188:33723)
0808 14:56:53.047900 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:53.047905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:53.084829 (+ 36924us) server_negotiation.cc:407] Connection header received
0808 14:56:53.085012 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:53.085017 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:53.085110 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:53.085266 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:53.087743 (+ 2477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:53.088860 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:53.090897 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:53.091543 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:53.091647 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:53.094742 (+ 3095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:53.094747 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:53.094751 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:53.094785 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:53.097804 (+ 3019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:53.098461 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:53.098467 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:53.098472 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:53.098610 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:53.099027 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:53.099031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:53.099033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:53.099322 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:53.099600 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:53.099957 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 14:56:53.100185 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:56:53.231269 23194 catalog_manager.cc:4841] TS 07f82f449cc24186af5e93b4be94a7cb (127.12.73.131:34879): tablet aac972569dd04dda972c11d4fca6fbff (table test-table [id=1f9ab0ad75bd4c0a874e2433fa1f2190]) successfully deleted
I20260808 14:56:53.231700 23193 catalog_manager.cc:4841] TS 98cecc11e2664821a6edf4742860bb92 (127.12.73.129:38439): tablet aac972569dd04dda972c11d4fca6fbff (table test-table [id=1f9ab0ad75bd4c0a874e2433fa1f2190]) successfully deleted
I20260808 14:56:53.231734 23194 catalog_manager.cc:4841] TS a4e6d619d8a54a5ea710ecdbac8c014e (127.12.73.130:37051): tablet aac972569dd04dda972c11d4fca6fbff (table test-table [id=1f9ab0ad75bd4c0a874e2433fa1f2190]) successfully deleted
W20260808 14:56:53.231906 23193 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.73.129:38439, user_credentials={real_user=slave}} blocked reactor thread for 168276us
I20260808 14:56:53.232388 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 23165
I20260808 14:56:53.286307 25250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:53.268227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49244 (local address 127.12.73.188:33723)
0808 14:56:53.268495 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:53.268504 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:53.269936 (+ 1432us) server_negotiation.cc:407] Connection header received
0808 14:56:53.270140 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:53.270146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:53.270245 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:53.270358 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:53.272692 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:53.273734 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:53.275082 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:53.275672 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:53.275795 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:53.279503 (+ 3708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:53.279511 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:53.279515 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:53.279552 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:53.283127 (+ 3575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:53.284060 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:53.284067 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:53.284071 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:53.284238 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:53.284673 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:53.284680 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:53.284685 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:53.285084 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:53.285344 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:53.285712 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 14:56:53.285953 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 14:56:53.287170 25249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:53.269413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38218 (local address 127.12.73.189:35655)
0808 14:56:53.269639 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:53.269645 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:53.270347 (+ 702us) server_negotiation.cc:407] Connection header received
0808 14:56:53.270624 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:53.270631 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:53.270698 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:53.270803 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:53.272241 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:53.273337 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:53.275386 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:53.276082 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:53.276231 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:53.279217 (+ 2986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:53.279224 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:53.279234 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:53.279268 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:53.283108 (+ 3840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:53.283919 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:53.283927 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:53.283932 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:53.284124 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:53.284546 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:53.284551 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:53.284554 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:53.284892 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:53.285190 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:53.286607 (+ 1417us) server_negotiation.cc:299] Negotiation successful
0808 14:56:53.286846 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:56:54.005625 25359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.004757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.129:36371)
0808 14:56:54.005222 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.005411 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":213,"threads_started":1}
W20260808 14:56:54.006255 24780 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:33041 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
I20260808 14:56:54.010090 25361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.009230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.130:39367)
0808 14:56:54.009773 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.009926 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":257,"threads_started":1}
W20260808 14:56:54.010528 25007 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:33041 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
I20260808 14:56:54.014067 25362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.013437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.131:47907)
0808 14:56:54.013807 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.013915 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":189,"threads_started":1}
W20260808 14:56:54.014575 25245 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:33041 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
I20260808 14:56:54.522073 25364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80fc452b6d8e4c0a8a7147a0dc426fdc)
I20260808 14:56:54.522209 25366 raft_consensus.cc:482] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80fc452b6d8e4c0a8a7147a0dc426fdc)
I20260808 14:56:54.522409 25364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } }
I20260808 14:56:54.522490 25366 raft_consensus.cc:504] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } }
I20260808 14:56:54.523805 25364 leader_election.cc:288] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80fc452b6d8e4c0a8a7147a0dc426fdc (127.12.73.190:33041), a774ed42d1cc48eb9aea7c34edbf0b62 (127.12.73.188:33723)
I20260808 14:56:54.523815 25366 leader_election.cc:288] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80fc452b6d8e4c0a8a7147a0dc426fdc (127.12.73.190:33041), 3a171e960906486dbf7e021325e12b2b (127.12.73.189:35655)
I20260808 14:56:54.525808 25367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.523898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:53988)
0808 14:56:54.524492 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.525477 (+ 985us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":291,"threads_started":1}
W20260808 14:56:54.526221 24186 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
I20260808 14:56:54.530113 25368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.524041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:53986)
0808 14:56:54.529438 (+ 5397us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.529742 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5266,"thread_start_us":1803,"threads_started":1}
I20260808 14:56:54.532344 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.524980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49256 (local address 127.12.73.188:33723)
0808 14:56:54.526259 (+ 1279us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:54.526265 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:54.526289 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:56:54.526340 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:54.526364 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:54.526447 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:54.526587 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:54.527190 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.528054 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.530442 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.531326 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.531466 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.531558 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:54.531854 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 14:56:54.531984 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1163,"thread_start_us":276,"threads_started":1}
I20260808 14:56:54.532343 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.524431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:33723 (local address 127.0.0.1:49256)
0808 14:56:54.525683 (+ 1252us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.525702 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:54.525870 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:54.526609 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:54.526614 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:54.526641 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:54.527009 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.527024 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.528196 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.528201 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.530259 (+ 2058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.530275 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.531490 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.531496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.531673 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.531713 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 14:56:54.531819 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:56:54.531954 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1113,"thread_start_us":960,"threads_started":1}
I20260808 14:56:54.533259 24511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a171e960906486dbf7e021325e12b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" is_pre_election: true
I20260808 14:56:54.533636 24511 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a171e960906486dbf7e021325e12b2b in term 1.
I20260808 14:56:54.534236 24187 leader_election.cc:302] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a171e960906486dbf7e021325e12b2b, a774ed42d1cc48eb9aea7c34edbf0b62; no voters:
I20260808 14:56:54.534691 25364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 14:56:54.534873 25364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80fc452b6d8e4c0a8a7147a0dc426fdc)
I20260808 14:56:54.535058 25364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 1 FOLLOWER]: Advancing to term 2
W20260808 14:56:54.537031 24475 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
I20260808 14:56:54.539306 25364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } }
I20260808 14:56:54.539842 25368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.526226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:35655 (local address 127.0.0.1:38230)
0808 14:56:54.530452 (+ 4226us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.530469 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:54.530580 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:54.533964 (+ 3384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:54.533968 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:54.534010 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:54.534286 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.534298 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.535934 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.535940 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.537831 (+ 1891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.537843 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.539036 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.539042 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.539231 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.539271 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 14:56:54.539385 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 14:56:54.539531 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4140,"thread_start_us":10494,"threads_started":1}
I20260808 14:56:54.539919 25376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.526459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38230 (local address 127.12.73.189:35655)
0808 14:56:54.533622 (+ 7163us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:54.533630 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:54.533661 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:56:54.533720 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:54.533727 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:54.533795 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:54.534431 (+ 636us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:54.534738 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.535802 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.537993 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.538836 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.538993 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.539214 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:54.539407 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 14:56:54.539537 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7039,"thread_start_us":6885,"threads_started":1}
I20260808 14:56:54.540627 25364 leader_election.cc:288] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [CANDIDATE]: Term 2 election: Requested vote from peers 80fc452b6d8e4c0a8a7147a0dc426fdc (127.12.73.190:33041), a774ed42d1cc48eb9aea7c34edbf0b62 (127.12.73.188:33723)
I20260808 14:56:54.541126 24511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a171e960906486dbf7e021325e12b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62"
I20260808 14:56:54.541416 24511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:56:54.541607 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.541155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:54002)
0808 14:56:54.541362 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.541473 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260808 14:56:54.541872 24186 leader_election.cc:334] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80fc452b6d8e4c0a8a7147a0dc426fdc (127.12.73.190:33041): Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
I20260808 14:56:54.542282 24229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3a171e960906486dbf7e021325e12b2b" is_pre_election: true
I20260808 14:56:54.542650 24229 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a774ed42d1cc48eb9aea7c34edbf0b62 in current term 2: Already voted for candidate 3a171e960906486dbf7e021325e12b2b in this term.
I20260808 14:56:54.542939 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.542526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:54010)
0808 14:56:54.542664 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.542773 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 14:56:54.543270 24186 leader_election.cc:334] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 80fc452b6d8e4c0a8a7147a0dc426fdc (127.12.73.190:33041): Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
I20260808 14:56:54.543582 25368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.543140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:54016)
0808 14:56:54.543319 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.543417 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 14:56:54.543782 24475 leader_election.cc:334] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80fc452b6d8e4c0a8a7147a0dc426fdc (127.12.73.190:33041): Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
I20260808 14:56:54.544003 24475 leader_election.cc:302] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a774ed42d1cc48eb9aea7c34edbf0b62; no voters: 3a171e960906486dbf7e021325e12b2b, 80fc452b6d8e4c0a8a7147a0dc426fdc
I20260808 14:56:54.544827 24511 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a171e960906486dbf7e021325e12b2b in term 2.
I20260808 14:56:54.545001 25366 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:56:54.545243 24187 leader_election.cc:302] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a171e960906486dbf7e021325e12b2b, a774ed42d1cc48eb9aea7c34edbf0b62; no voters: 80fc452b6d8e4c0a8a7147a0dc426fdc
I20260808 14:56:54.545542 25364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:56:54.545965 25364 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [term 2 LEADER]: Becoming Leader. State: Replica: 3a171e960906486dbf7e021325e12b2b, State: Running, Role: LEADER
I20260808 14:56:54.546355 25364 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } }
I20260808 14:56:54.548180 25382 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a171e960906486dbf7e021325e12b2b. Latest consensus state: current_term: 2 leader_uuid: "3a171e960906486dbf7e021325e12b2b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } } }
I20260808 14:56:54.548604 25382 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:54.549511 25386 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:54.553014 25386 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:54.553900 25386 catalog_manager.cc:1259] Loaded cluster ID: 94f6c4af6b0347cd904fd18469068e2a
I20260808 14:56:54.554016 25386 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:54.555284 25386 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:54.556080 25386 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: Loaded TSK: 0
I20260808 14:56:54.556885 25386 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:56:54.578150 24214 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38218:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:56:54.585116 24214 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:56:54.589227 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.588728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:54042)
0808 14:56:54.588895 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.589001 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 14:56:54.589310 24511 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [term 2 FOLLOWER]: Refusing update from remote peer 3a171e960906486dbf7e021325e12b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 14:56:54.590044 25382 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 14:56:54.590282 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.589865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:54056)
0808 14:56:54.590064 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.590129 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:56:54.590437 24186 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b -> Peer 80fc452b6d8e4c0a8a7147a0dc426fdc (127.12.73.190:33041): Couldn't send request to peer 80fc452b6d8e4c0a8a7147a0dc426fdc. Status: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 14:56:54.592561 25366 sys_catalog.cc:455] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a171e960906486dbf7e021325e12b2b. Latest consensus state: current_term: 2 leader_uuid: "3a171e960906486dbf7e021325e12b2b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } } }
I20260808 14:56:54.592861 25366 sys_catalog.cc:458] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:56:54.594489 25364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "3a171e960906486dbf7e021325e12b2b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } } }
I20260808 14:56:54.594841 25364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:54.594944 25366 sys_catalog.cc:455] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "3a171e960906486dbf7e021325e12b2b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "80fc452b6d8e4c0a8a7147a0dc426fdc" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33041 } } peers { permanent_uuid: "3a171e960906486dbf7e021325e12b2b" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 35655 } attrs { promote: false } } peers { permanent_uuid: "a774ed42d1cc48eb9aea7c34edbf0b62" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 33723 } attrs { promote: false } } }
I20260808 14:56:54.595216 25366 sys_catalog.cc:458] T 00000000000000000000000000000000 P a774ed42d1cc48eb9aea7c34edbf0b62 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:56:54.620239 25394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.603251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47908 (local address 127.12.73.131:34879)
0808 14:56:54.610006 (+ 6755us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:54.610015 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:54.610044 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:56:54.610152 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:54.610160 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:54.610265 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:54.610402 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:54.611534 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.612996 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.617519 (+ 4523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.619262 (+ 1743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.619408 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.619507 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:54.619791 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 14:56:54.619925 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6571,"thread_start_us":6437,"threads_started":1}
I20260808 14:56:54.620247 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.603127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:34879 (local address 127.0.0.1:47908)
0808 14:56:54.603272 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.603293 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:54.603402 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:54.610455 (+ 7053us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:54.610483 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:54.610525 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:54.610800 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.610815 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.615053 (+ 4238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.615062 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.617298 (+ 2236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.617313 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.619415 (+ 2102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.619420 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.619617 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.619644 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 14:56:54.619764 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 14:56:54.619916 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 14:56:54.621028 25141 tablet_service.cc:1467] Processing CreateTablet for tablet 1667a79338c94d1a84396b9d973a4142 (DEFAULT_TABLE table=test-table [id=9098748e13444ea88794e72896275a1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:54.621562 25141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1667a79338c94d1a84396b9d973a4142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:54.623936 25367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.603417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:37051 (local address 127.0.0.1:45180)
0808 14:56:54.603742 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.603759 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:54.603854 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:54.617865 (+ 14011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:54.617875 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:54.617904 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:54.618240 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.618251 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.619728 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.619734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.621843 (+ 2109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.621860 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.623207 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.623214 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.623385 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.623407 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:56:54.623519 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 14:56:54.623658 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":1}
I20260808 14:56:54.623976 25400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.604137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45180 (local address 127.12.73.130:37051)
0808 14:56:54.617533 (+ 13396us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:54.617539 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:54.617558 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:56:54.617631 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:54.617636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:54.617719 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:54.617819 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:54.618503 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.619565 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.622056 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.623008 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.623157 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.623267 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:54.623555 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 14:56:54.623687 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13179,"thread_start_us":13020,"threads_started":1}
I20260808 14:56:54.624969 24899 tablet_service.cc:1467] Processing CreateTablet for tablet 1667a79338c94d1a84396b9d973a4142 (DEFAULT_TABLE table=test-table [id=9098748e13444ea88794e72896275a1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:54.625424 24899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1667a79338c94d1a84396b9d973a4142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:54.625717 25398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.603800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38439 (local address 127.0.0.1:50864)
0808 14:56:54.616684 (+ 12884us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.616703 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:54.616844 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:54.617541 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:54.617546 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:54.617574 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:54.617913 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.617925 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.619473 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.619478 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.622369 (+ 2891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.622384 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.624854 (+ 2470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.624860 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.625061 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.625095 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 14:56:54.625222 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 14:56:54.625343 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12764,"mutex_wait_us":610,"thread_start_us":12636,"threads_started":1}
I20260808 14:56:54.626398 25399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.603993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50864 (local address 127.12.73.129:38439)
0808 14:56:54.616252 (+ 12259us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:54.616258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:54.616826 (+ 568us) server_negotiation.cc:407] Connection header received
0808 14:56:54.617007 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:54.617015 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:54.617153 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:54.617315 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:54.618195 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.619322 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.622530 (+ 3208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.623716 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.624574 (+ 858us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.624708 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:54.625959 (+ 1251us) server_negotiation.cc:299] Negotiation successful
0808 14:56:54.626113 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12116,"thread_start_us":12928,"threads_started":1}
I20260808 14:56:54.627092 24670 tablet_service.cc:1467] Processing CreateTablet for tablet 1667a79338c94d1a84396b9d973a4142 (DEFAULT_TABLE table=test-table [id=9098748e13444ea88794e72896275a1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:56:54.627537 24670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1667a79338c94d1a84396b9d973a4142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:54.628396 25402 tablet_bootstrap.cc:492] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb: Bootstrap starting.
I20260808 14:56:54.630080 25402 tablet_bootstrap.cc:654] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:54.631973 25405 tablet_bootstrap.cc:492] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e: Bootstrap starting.
I20260808 14:56:54.634191 25408 tablet_bootstrap.cc:492] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92: Bootstrap starting.
I20260808 14:56:54.634461 25405 tablet_bootstrap.cc:654] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:54.635680 25402 tablet_bootstrap.cc:492] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb: No bootstrap required, opened a new log
I20260808 14:56:54.635838 25402 ts_tablet_manager.cc:1397] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260808 14:56:54.636077 25408 tablet_bootstrap.cc:654] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:54.636584 25405 tablet_bootstrap.cc:492] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e: No bootstrap required, opened a new log
I20260808 14:56:54.636739 25405 ts_tablet_manager.cc:1397] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260808 14:56:54.636678 25402 raft_consensus.cc:348] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:54.636931 25402 raft_consensus.cc:374] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:54.637097 25402 raft_consensus.cc:729] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f82f449cc24186af5e93b4be94a7cb, State: Initialized, Role: FOLLOWER
I20260808 14:56:54.637388 25402 consensus_queue.cc:260] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:54.637615 25405 raft_consensus.cc:348] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:54.637946 25405 raft_consensus.cc:374] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:54.638087 25405 raft_consensus.cc:729] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4e6d619d8a54a5ea710ecdbac8c014e, State: Initialized, Role: FOLLOWER
I20260808 14:56:54.638283 25402 ts_tablet_manager.cc:1428] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:56:54.638360 25408 tablet_bootstrap.cc:492] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92: No bootstrap required, opened a new log
I20260808 14:56:54.638553 25408 ts_tablet_manager.cc:1397] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260808 14:56:54.638469 25405 consensus_queue.cc:260] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:54.639357 25408 raft_consensus.cc:348] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:54.639652 25408 raft_consensus.cc:374] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:54.639810 25408 raft_consensus.cc:729] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98cecc11e2664821a6edf4742860bb92, State: Initialized, Role: FOLLOWER
I20260808 14:56:54.640139 25408 consensus_queue.cc:260] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:54.645706 25405 ts_tablet_manager.cc:1428] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e: Time spent starting tablet: real 0.009s user 0.004s sys 0.005s
I20260808 14:56:54.647512 25423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.646534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.129:59411)
0808 14:56:54.647098 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.647261 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":284,"threads_started":1}
I20260808 14:56:54.648048 25408 ts_tablet_manager.cc:1428] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92: Time spent starting tablet: real 0.009s user 0.002s sys 0.005s
I20260808 14:56:54.649315 25423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.648894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.129:36681)
0808 14:56:54.649076 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.649190 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 14:56:54.650429 24781 heartbeater.cc:503] Master 127.12.73.189:35655 was elected leader, sending a full tablet report...
I20260808 14:56:54.653949 25417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.638927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.131:47081)
0808 14:56:54.653570 (+ 14643us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.653709 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14537,"threads_started":1}
I20260808 14:56:54.653995 25422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.646342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.130:44489)
0808 14:56:54.653648 (+ 7306us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.653794 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7160,"thread_start_us":7019,"threads_started":1}
I20260808 14:56:54.655198 25008 heartbeater.cc:503] Master 127.12.73.189:35655 was elected leader, sending a full tablet report...
I20260808 14:56:54.655252 25422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.654826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.130:36155)
0808 14:56:54.655013 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.655113 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 14:56:54.655313 25417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.654906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.131:44755)
0808 14:56:54.655092 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.655176 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 14:56:54.656008 25246 heartbeater.cc:503] Master 127.12.73.189:35655 was elected leader, sending a full tablet report...
I20260808 14:56:54.726034 25414 raft_consensus.cc:482] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:56:54.726257 25414 raft_consensus.cc:504] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:54.727850 25414 leader_election.cc:288] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4e6d619d8a54a5ea710ecdbac8c014e (127.12.73.130:37051), 98cecc11e2664821a6edf4742860bb92 (127.12.73.129:38439)
I20260808 14:56:54.735275 25399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.728486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:59799 (local address 127.12.73.129:38439)
0808 14:56:54.728751 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:54.728758 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:54.729452 (+ 694us) server_negotiation.cc:407] Connection header received
0808 14:56:54.729686 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:54.729691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:54.729773 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:54.729880 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:54.730364 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.731176 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.733500 (+ 2324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.734301 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.734482 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.734559 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:54.734886 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 14:56:54.735013 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 14:56:54.735368 25400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.728335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:37897 (local address 127.12.73.130:37051)
0808 14:56:54.728574 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:54.728583 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:54.728609 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:56:54.728721 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:54.728728 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:54.728828 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:54.728963 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:56:54.729684 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.730658 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.733106 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.734438 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.734621 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.734699 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:54.734984 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 14:56:54.735113 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:56:54.735468 25424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.728252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38439 (local address 127.12.73.131:59799)
0808 14:56:54.729339 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.729361 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:54.729499 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:54.729946 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:54.729951 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:54.729977 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:54.730212 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.730221 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.731304 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.731310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.733343 (+ 2033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.733354 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.734493 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.734499 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.734722 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.734747 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 14:56:54.734857 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:56:54.734988 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":948,"mutex_wait_us":25,"thread_start_us":749,"threads_started":1}
I20260808 14:56:54.735497 25417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.728164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:37051 (local address 127.12.73.131:37897)
0808 14:56:54.728352 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.728372 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:54.728502 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:54.729055 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:54.729062 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:54.729123 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:56:54.729518 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.729531 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.730797 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.730801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.732908 (+ 2107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:54.732925 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.734643 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.734651 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:54.734826 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.734852 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 14:56:54.734958 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:56:54.735100 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":23}
I20260808 14:56:54.736286 24932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1667a79338c94d1a84396b9d973a4142" candidate_uuid: "07f82f449cc24186af5e93b4be94a7cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" is_pre_election: true
I20260808 14:56:54.736439 24702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1667a79338c94d1a84396b9d973a4142" candidate_uuid: "07f82f449cc24186af5e93b4be94a7cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98cecc11e2664821a6edf4742860bb92" is_pre_election: true
I20260808 14:56:54.736609 24932 raft_consensus.cc:2454] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f82f449cc24186af5e93b4be94a7cb in term 0.
I20260808 14:56:54.736878 24702 raft_consensus.cc:2454] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f82f449cc24186af5e93b4be94a7cb in term 0.
I20260808 14:56:54.737159 25059 leader_election.cc:302] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f82f449cc24186af5e93b4be94a7cb, a4e6d619d8a54a5ea710ecdbac8c014e; no voters:
I20260808 14:56:54.737592 25414 raft_consensus.cc:2781] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:56:54.737737 25414 raft_consensus.cc:482] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:56:54.737849 25414 raft_consensus.cc:3037] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:54.739981 25414 raft_consensus.cc:504] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:54.740579 25414 leader_election.cc:288] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [CANDIDATE]: Term 1 election: Requested vote from peers a4e6d619d8a54a5ea710ecdbac8c014e (127.12.73.130:37051), 98cecc11e2664821a6edf4742860bb92 (127.12.73.129:38439)
I20260808 14:56:54.741021 24702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1667a79338c94d1a84396b9d973a4142" candidate_uuid: "07f82f449cc24186af5e93b4be94a7cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98cecc11e2664821a6edf4742860bb92"
I20260808 14:56:54.741029 24932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1667a79338c94d1a84396b9d973a4142" candidate_uuid: "07f82f449cc24186af5e93b4be94a7cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e"
I20260808 14:56:54.741254 24932 raft_consensus.cc:3037] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:54.741487 24702 raft_consensus.cc:3037] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:54.743257 24932 raft_consensus.cc:2454] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f82f449cc24186af5e93b4be94a7cb in term 1.
I20260808 14:56:54.743642 25059 leader_election.cc:302] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f82f449cc24186af5e93b4be94a7cb, a4e6d619d8a54a5ea710ecdbac8c014e; no voters:
I20260808 14:56:54.743764 24702 raft_consensus.cc:2454] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f82f449cc24186af5e93b4be94a7cb in term 1.
I20260808 14:56:54.743934 25414 raft_consensus.cc:2781] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:54.744450 25414 raft_consensus.cc:686] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 1 LEADER]: Becoming Leader. State: Replica: 07f82f449cc24186af5e93b4be94a7cb, State: Running, Role: LEADER
I20260808 14:56:54.744810 25414 consensus_queue.cc:237] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } }
I20260808 14:56:54.745572 25417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.745209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.131:45785)
0808 14:56:54.745334 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.745407 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 14:56:54.749050 24214 catalog_manager.cc:5495] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f82f449cc24186af5e93b4be94a7cb (127.12.73.131). New cstate: current_term: 1 leader_uuid: "07f82f449cc24186af5e93b4be94a7cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f82f449cc24186af5e93b4be94a7cb" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260808 14:56:54.765750 25394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.760755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47910 (local address 127.12.73.131:34879)
0808 14:56:54.760910 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:54.760915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:54.761006 (+ 91us) server_negotiation.cc:407] Connection header received
0808 14:56:54.761217 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:54.761224 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:54.761318 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:54.761440 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:56:54.761752 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.762480 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.763705 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.764086 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.764235 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.764556 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:56:54.765171 (+ 615us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:56:54.765341 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:54.765426 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 14:56:54.765487 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:56:54.769497 24932 raft_consensus.cc:1261] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e [term 1 FOLLOWER]: Refusing update from remote peer 07f82f449cc24186af5e93b4be94a7cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:54.769773 24702 raft_consensus.cc:1261] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92 [term 1 FOLLOWER]: Refusing update from remote peer 07f82f449cc24186af5e93b4be94a7cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:56:54.770175 25425 consensus_queue.cc:1035] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4e6d619d8a54a5ea710ecdbac8c014e" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:54.770505 25414 consensus_queue.cc:1035] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "98cecc11e2664821a6edf4742860bb92" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:56:54.773397 25422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.772885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.130:49831)
0808 14:56:54.773017 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.773141 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:56:54.773885 25423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.773331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.129:51619)
0808 14:56:54.773517 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.773638 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 14:56:54.778903 25433 mvcc.cc:205] Tried to move back new op lower bound from 7316279356489019392 to 7316279356398915584. Current Snapshot: MvccSnapshot[applied={T|T < 7316279356489019392}]
I20260808 14:56:54.779950 25423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.779484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.129:51101)
0808 14:56:54.779709 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.779795 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260808 14:56:54.781930 25435 mvcc.cc:205] Tried to move back new op lower bound from 7316279356489019392 to 7316279356398915584. Current Snapshot: MvccSnapshot[applied={T|T < 7316279356489019392}]
I20260808 14:56:54.783214 25422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.782773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.130:56757)
0808 14:56:54.782991 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.783073 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260808 14:56:54.783620 25417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.783058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.12.73.131:42989)
0808 14:56:54.783385 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.783471 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196}
I20260808 14:56:54.795475 24215 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:54.795771 24215 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:56:54.801419 24215 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a171e960906486dbf7e021325e12b2b: Sending DeleteTablet for 3 replicas of tablet 1667a79338c94d1a84396b9d973a4142
I20260808 14:56:54.802619 25141 tablet_service.cc:1514] Processing DeleteTablet for tablet 1667a79338c94d1a84396b9d973a4142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:54 UTC) from {username='oryx', principal='oryx/127.12.73.189@KRBTEST.COM'} at 127.0.0.1:47908
I20260808 14:56:54.802934 24899 tablet_service.cc:1514] Processing DeleteTablet for tablet 1667a79338c94d1a84396b9d973a4142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:54 UTC) from {username='oryx', principal='oryx/127.12.73.189@KRBTEST.COM'} at 127.0.0.1:45180
I20260808 14:56:54.803092 24670 tablet_service.cc:1514] Processing DeleteTablet for tablet 1667a79338c94d1a84396b9d973a4142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:56:54 UTC) from {username='oryx', principal='oryx/127.12.73.189@KRBTEST.COM'} at 127.0.0.1:50864
I20260808 14:56:54.803356 25447 tablet_replica.cc:330] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb: stopping tablet replica
I20260808 14:56:54.803627 25447 raft_consensus.cc:2229] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:56:54.804258 25447 raft_consensus.cc:2258] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:54.805444 25447 ts_tablet_manager.cc:1905] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:54.806080 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 24554
I20260808 14:56:54.814011 25447 ts_tablet_manager.cc:1918] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:54.814232 25447 log.cc:1196] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/1667a79338c94d1a84396b9d973a4142
I20260808 14:56:54.814740 25447 ts_tablet_manager.cc:1939] T 1667a79338c94d1a84396b9d973a4142 P 07f82f449cc24186af5e93b4be94a7cb: Deleting consensus metadata
I20260808 14:56:54.814754 25450 tablet_replica.cc:330] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e: stopping tablet replica
I20260808 14:56:54.814976 25450 raft_consensus.cc:2229] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:54.815166 25455 tablet_replica.cc:330] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92: stopping tablet replica
I20260808 14:56:54.815399 25450 raft_consensus.cc:2258] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:54.815464 25455 raft_consensus.cc:2229] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:56:54.815827 25455 raft_consensus.cc:2258] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:56:54.816067 24187 catalog_manager.cc:4841] TS 07f82f449cc24186af5e93b4be94a7cb (127.12.73.131:34879): tablet 1667a79338c94d1a84396b9d973a4142 (table test-table [id=9098748e13444ea88794e72896275a1f]) successfully deleted
I20260808 14:56:54.816653 25450 ts_tablet_manager.cc:1905] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:54.816977 25455 ts_tablet_manager.cc:1905] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:56:54.823168 25450 ts_tablet_manager.cc:1918] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:54.823310 25450 log.cc:1196] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/1667a79338c94d1a84396b9d973a4142
I20260808 14:56:54.823889 25450 ts_tablet_manager.cc:1939] T 1667a79338c94d1a84396b9d973a4142 P a4e6d619d8a54a5ea710ecdbac8c014e: Deleting consensus metadata
I20260808 14:56:54.824975 24187 catalog_manager.cc:4841] TS a4e6d619d8a54a5ea710ecdbac8c014e (127.12.73.130:37051): tablet 1667a79338c94d1a84396b9d973a4142 (table test-table [id=9098748e13444ea88794e72896275a1f]) successfully deleted
I20260808 14:56:54.827329 25455 ts_tablet_manager.cc:1918] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:56:54.827471 25455 log.cc:1196] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/1667a79338c94d1a84396b9d973a4142
I20260808 14:56:54.828009 25455 ts_tablet_manager.cc:1939] T 1667a79338c94d1a84396b9d973a4142 P 98cecc11e2664821a6edf4742860bb92: Deleting consensus metadata
I20260808 14:56:54.829360 24186 catalog_manager.cc:4841] TS 98cecc11e2664821a6edf4742860bb92 (127.12.73.129:38439): tablet 1667a79338c94d1a84396b9d973a4142 (table test-table [id=9098748e13444ea88794e72896275a1f]) successfully deleted
I20260808 14:56:54.834290 25399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.807115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50874 (local address 127.12.73.129:38439)
0808 14:56:54.807319 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:54.807330 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:54.817650 (+ 10320us) server_negotiation.cc:407] Connection header received
0808 14:56:54.817949 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:54.817955 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:54.818046 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:54.818153 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:54.820010 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.821071 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.822937 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:54.823618 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:54.823755 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:54.827765 (+ 4010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:54.827788 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:54.827811 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:54.827856 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:54.831276 (+ 3420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:54.832130 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:54.832140 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:54.832143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:54.832298 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:54.832746 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:54.832749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:54.832751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:54.833076 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:54.833362 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:54.833747 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 14:56:54.833909 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:56:54.834967 24770 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:54.969324 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 24554
I20260808 14:56:54.969816 25398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.969253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:54058)
0808 14:56:54.969528 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.969633 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260808 14:56:54.971395 25398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:54.970898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33041 (local address 127.0.0.1:54068)
0808 14:56:54.971094 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:54.971211 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:33041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 14:56:55.007573 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 24794
I20260808 14:56:55.024742 25400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:55.008952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45186 (local address 127.12.73.130:37051)
0808 14:56:55.009140 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:55.009146 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:55.009194 (+ 48us) server_negotiation.cc:407] Connection header received
0808 14:56:55.009262 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:55.009269 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:55.009381 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:55.009490 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:55.011494 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:55.012681 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:55.014666 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:55.015034 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:55.015139 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:55.018823 (+ 3684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:55.018838 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:55.018851 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:55.018890 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:55.021954 (+ 3064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:55.022761 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:55.022769 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:55.022771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:55.022893 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:55.023336 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:55.023339 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:55.023341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:55.023684 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:55.023915 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:55.024259 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 14:56:55.024423 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:56:55.025490 24998 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:55.121155 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 24794
I20260808 14:56:55.152154 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 25028
I20260808 14:56:55.168740 25394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:55.152993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47922 (local address 127.12.73.131:34879)
0808 14:56:55.153229 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:55.153236 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:55.153264 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:56:55.153398 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:55.153404 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:55.153524 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:55.153643 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:55.155073 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:55.156310 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:55.157638 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:55.158362 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:55.158517 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:55.161159 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:55.161333 (+ 174us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:55.161362 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:55.161406 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:55.165492 (+ 4086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:55.166300 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:55.166309 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:55.166312 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:55.166539 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:55.167028 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:55.167034 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:55.167038 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:55.167540 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:55.167901 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:55.168065 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 14:56:55.168346 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:56:55.169693 25236 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:55.312866 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 25028
I20260808 14:56:55.342680 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 23977
I20260808 14:56:55.343981 24255 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:55.469655 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 23977
I20260808 14:56:55.497037 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 24155
I20260808 14:56:55.498327 24541 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:56:55.614652 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 24155
2026-08-08T14:56:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10201 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:56:55 dist-test-slave-z8x9 krb5kdc[25470](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:56:55 dist-test-slave-z8x9 krb5kdc[25470](info): set up 2 sockets
Aug 08 14:56:55 dist-test-slave-z8x9 krb5kdc[25470](info): commencing operation
krb5kdc: starting...
W20260808 14:56:56.959070 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.289s user 0.001s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:56:57 dist-test-slave-z8x9 krb5kdc[25470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:56:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:56:57Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.190.keytab.
Entry for principal oryx/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.190.keytab.
I20260808 14:56:57.222855 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:35697
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.190.keytab
--principal=oryx/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:35697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:57.551774 25488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:57.552090 25488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:57.552265 25488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:57.559515 25488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:56:57.559616 25488 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:56:57.559702 25488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:57.559795 25488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:57.559922 25488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:56:57.560029 25488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:56:57.569970 25488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:35697
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.190.keytab
--principal=oryx/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:35697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:57.571251 25488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:57.572583 25488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:57.584290 25498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:57.584306 25504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:57.584336 25500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:57.585781 25488 server_base.cc:1034] running on GCE node
I20260808 14:56:57.586591 25488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:57.587955 25488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:57.589253 25488 hybrid_clock.cc:648] HybridClock initialized: now 1786201017589138 us; error 57 us; skew 500 ppm
I20260808 14:56:57.589600 25488 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:57 dist-test-slave-z8x9 krb5kdc[25470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201017, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:57.592911 25488 init.cc:377] Logged in from keytab as oryx/127.12.73.190@KRBTEST.COM (short username oryx)
I20260808 14:56:57.594549 25488 webserver.cc:460] Webserver started at http://127.12.73.190:43499/ using document root <none> and password file <none>
I20260808 14:56:57.595311 25488 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:57.595445 25488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:57.595805 25488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:57.598919 25488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "a6f88d20c1e943d9b9523ec88131bf55"
format_stamp: "Formatted at 2026-08-08 14:56:57 on dist-test-slave-z8x9"
server_key: "6ca8e1701faec565ada4639fbb2f91c5"
server_key_iv: "371e727ddb86094bf10f65a7bb5cd14f"
server_key_version: "encryptionkey@0"
I20260808 14:56:57.599776 25488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "a6f88d20c1e943d9b9523ec88131bf55"
format_stamp: "Formatted at 2026-08-08 14:56:57 on dist-test-slave-z8x9"
server_key: "6ca8e1701faec565ada4639fbb2f91c5"
server_key_iv: "371e727ddb86094bf10f65a7bb5cd14f"
server_key_version: "encryptionkey@0"
I20260808 14:56:57.604986 25488 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:56:57.608832 25513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:57.610314 25488 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:57.610529 25488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "a6f88d20c1e943d9b9523ec88131bf55"
format_stamp: "Formatted at 2026-08-08 14:56:57 on dist-test-slave-z8x9"
server_key: "6ca8e1701faec565ada4639fbb2f91c5"
server_key_iv: "371e727ddb86094bf10f65a7bb5cd14f"
server_key_version: "encryptionkey@0"
I20260808 14:56:57.610775 25488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:57.622382 25488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:57.626382 25488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:57.626732 25488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:57.648823 25488 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:35697
I20260808 14:56:57.648847 25615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:35697 every 8 connection(s)
I20260808 14:56:57.650286 25488 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:56:57.653973 25616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:56:57.657572 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 25488
I20260808 14:56:57.657797 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:56:57.658453 12582 external_mini_cluster.cc:1428] Setting key 4682cb5a3584ef4f878e49b59105bbef
I20260808 14:56:57.667248 25616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55: Bootstrap starting.
I20260808 14:56:57.670876 25616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55: Neither blocks nor log segments found. Creating new log.
I20260808 14:56:57.671845 25616 log.cc:824] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:56:57 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:56:57.674883 25616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55: No bootstrap required, opened a new log
I20260808 14:56:57.682116 25619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:57.660551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50868 (local address 127.12.73.190:35697)
0808 14:56:57.661386 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:57.661402 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:57.661453 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:56:57.663150 (+ 1697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:57.663183 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:57.663683 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:57.664098 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:57.665529 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:57.667439 (+ 1910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:57.668709 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:57.669755 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:57.669941 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:57.674081 (+ 4140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:57.674092 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:57.674111 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:57.674157 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:57.677711 (+ 3554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:57.678435 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:57.678442 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:57.678448 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:57.678625 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:57.679033 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:57.679038 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:57.679041 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:57.679601 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:57.679948 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:57.680474 (+ 526us) server_negotiation.cc:299] Negotiation successful
0808 14:56:57.680892 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":329,"threads_started":1}
I20260808 14:56:57.683041 25616 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6f88d20c1e943d9b9523ec88131bf55" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 35697 } }
I20260808 14:56:57.683423 25616 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:56:57.683578 25616 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6f88d20c1e943d9b9523ec88131bf55, State: Initialized, Role: FOLLOWER
I20260808 14:56:57.684185 25616 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6f88d20c1e943d9b9523ec88131bf55" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 35697 } }
I20260808 14:56:57.684450 25616 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:56:57.684603 25616 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:56:57.684783 25616 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:56:57.686961 25616 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6f88d20c1e943d9b9523ec88131bf55" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 35697 } }
I20260808 14:56:57.687464 25616 leader_election.cc:302] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6f88d20c1e943d9b9523ec88131bf55; no voters:
I20260808 14:56:57.688019 25616 leader_election.cc:288] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:56:57.688225 25621 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:56:57.688984 25621 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [term 1 LEADER]: Becoming Leader. State: Replica: a6f88d20c1e943d9b9523ec88131bf55, State: Running, Role: LEADER
I20260808 14:56:57.689555 25621 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6f88d20c1e943d9b9523ec88131bf55" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 35697 } }
I20260808 14:56:57.690450 25616 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:56:57.692796 25624 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6f88d20c1e943d9b9523ec88131bf55. Latest consensus state: current_term: 1 leader_uuid: "a6f88d20c1e943d9b9523ec88131bf55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6f88d20c1e943d9b9523ec88131bf55" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 35697 } } }
I20260808 14:56:57.693305 25624 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:57.693547 25622 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6f88d20c1e943d9b9523ec88131bf55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6f88d20c1e943d9b9523ec88131bf55" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 35697 } } }
I20260808 14:56:57.694164 25622 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55 [sys.catalog]: This master's current role is: LEADER
I20260808 14:56:57.696620 25628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:56:57.702081 25628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:56:57.710547 25628 catalog_manager.cc:1347] Generated new cluster ID: fc7be8f09a32488caf3d7e050c24bbdb
I20260808 14:56:57.710651 25628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:56:57.732197 25628 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:56:57.733558 25628 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:56:57.746898 25628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55: Generated new TSK 0
I20260808 14:56:57.748019 25628 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab.
Entry for principal oryx/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab.
I20260808 14:56:57.818854 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:35697
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab
--principal=oryx/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:58.158505 25661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:58.158809 25661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:58.158969 25661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:58.166333 25661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:58.166450 25661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:58.166620 25661 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:56:58.166751 25661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:56:58.176905 25661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab
--principal=oryx/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.73.190:35697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:58.178252 25661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:58.179651 25661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:58.195663 25674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:58.195886 25676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:58.195503 25672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:58.196751 25661 server_base.cc:1034] running on GCE node
I20260808 14:56:58.197561 25661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:58.198547 25661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:58.199821 25661 hybrid_clock.cc:648] HybridClock initialized: now 1786201018199739 us; error 47 us; skew 500 ppm
I20260808 14:56:58.200169 25661 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:58 dist-test-slave-z8x9 krb5kdc[25470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201018, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:58.203604 25661 init.cc:377] Logged in from keytab as oryx/127.12.73.129@KRBTEST.COM (short username oryx)
I20260808 14:56:58.205096 25661 webserver.cc:460] Webserver started at http://127.12.73.129:34187/ using document root <none> and password file <none>
I20260808 14:56:58.205856 25661 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:58.205998 25661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:58.206350 25661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:58.209383 25661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "75a1103a37cf43daa606eac2a688bdd2"
format_stamp: "Formatted at 2026-08-08 14:56:58 on dist-test-slave-z8x9"
server_key: "05c4d7656081861afb52e0c93689bdfe"
server_key_iv: "f3d03a48e4de3443a64bea099383f138"
server_key_version: "encryptionkey@0"
I20260808 14:56:58.210217 25661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "75a1103a37cf43daa606eac2a688bdd2"
format_stamp: "Formatted at 2026-08-08 14:56:58 on dist-test-slave-z8x9"
server_key: "05c4d7656081861afb52e0c93689bdfe"
server_key_iv: "f3d03a48e4de3443a64bea099383f138"
server_key_version: "encryptionkey@0"
I20260808 14:56:58.215628 25661 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:56:58.219242 25685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:58.220618 25661 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:56:58.220798 25661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "75a1103a37cf43daa606eac2a688bdd2"
format_stamp: "Formatted at 2026-08-08 14:56:58 on dist-test-slave-z8x9"
server_key: "05c4d7656081861afb52e0c93689bdfe"
server_key_iv: "f3d03a48e4de3443a64bea099383f138"
server_key_version: "encryptionkey@0"
I20260808 14:56:58.221033 25661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:58.257298 25661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:58.262071 25661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:58.262398 25661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:58.265049 25661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:58.265192 25661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:58.265367 25661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:58.265450 25661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:56:58 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201018, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:56:58.291900 25700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:58.265964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:35579 (local address 127.12.73.190:35697)
0808 14:56:58.266480 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:58.266487 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:58.267764 (+ 1277us) server_negotiation.cc:407] Connection header received
0808 14:56:58.270911 (+ 3147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:58.270917 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:58.271018 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:58.271164 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:58.273972 (+ 2808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.274935 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.278444 (+ 3509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.279000 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.279144 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:58.284355 (+ 5211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:58.284365 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:58.284372 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:58.284421 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:58.288019 (+ 3598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:58.289310 (+ 1291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:58.289316 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:58.289319 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:58.289456 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:58.289929 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:58.289935 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:58.289938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:58.290224 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:58.290386 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:58.291240 (+ 854us) server_negotiation.cc:299] Negotiation successful
0808 14:56:58.291474 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":272,"threads_started":1}
I20260808 14:56:58.292866 25701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:58.266596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:35697 (local address 127.12.73.129:35579)
0808 14:56:58.267529 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:58.267601 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:58.270510 (+ 2909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:58.271483 (+ 973us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:58.271509 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:58.272530 (+ 1021us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:58.273717 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:58.273758 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.275154 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.275163 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:58.278259 (+ 3096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:58.278280 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.279429 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.279435 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:58.279635 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:58.280435 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:58.280476 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:58.283979 (+ 3503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:58.288164 (+ 4185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:58.288177 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:58.288194 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:58.289153 (+ 959us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:58.289586 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:58.289592 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:58.289596 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:58.289804 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:58.290378 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:58.290386 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:58.290831 (+ 445us) client_negotiation.cc:769] Sending connection context
0808 14:56:58.291120 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 14:56:58.291670 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":389,"threads_started":1}
I20260808 14:56:58.315822 25700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:58.299331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:35381 (local address 127.12.73.190:35697)
0808 14:56:58.299578 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:58.299587 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:58.300187 (+ 600us) server_negotiation.cc:407] Connection header received
0808 14:56:58.300411 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:58.300414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:58.300474 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:58.300553 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:58.302246 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.303143 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.305260 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.306262 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.306457 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:58.308282 (+ 1825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:58.308293 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:58.308302 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:58.308357 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:58.312576 (+ 4219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:58.313307 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:58.313316 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:58.313324 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:58.313519 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:58.314104 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:58.314112 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:58.314129 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:58.314544 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:58.314699 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:58.315219 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 14:56:58.315450 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:56:58.315982 25796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:58.299233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:35697 (local address 127.12.73.129:35381)
0808 14:56:58.300042 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:58.300070 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:58.300271 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:58.300629 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:58.300638 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:58.301480 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:58.302053 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:58.302074 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.303279 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.303285 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:58.305054 (+ 1769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:58.305074 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.306468 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.306472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:58.306576 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:58.307298 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:58.307314 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:58.308047 (+ 733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:58.312740 (+ 4693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:58.312744 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:58.312746 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:58.313155 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:58.313739 (+ 584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:58.313746 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:58.313752 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:58.313945 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:58.314664 (+ 719us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:58.314669 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:58.314905 (+ 236us) client_negotiation.cc:769] Sending connection context
0808 14:56:58.315085 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 14:56:58.315525 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":367,"threads_started":1}
I20260808 14:56:58.323809 25661 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:44453
I20260808 14:56:58.323843 25858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:44453 every 8 connection(s)
I20260808 14:56:58.325266 25661 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:56:58.327445 25859 heartbeater.cc:347] Connected to a master server at 127.12.73.190:35697
I20260808 14:56:58.327678 25859 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:58.328313 25859 heartbeater.cc:511] Master 127.12.73.190:35697 requested a full tablet report, sending...
I20260808 14:56:58.330338 25547 ts_manager.cc:194] Registered new tserver with Master: 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453)
I20260808 14:56:58.331923 25547 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:35579
I20260808 14:56:58.335038 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 25661
I20260808 14:56:58.335244 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:56:58.335882 12582 external_mini_cluster.cc:1428] Setting key 2feefd4f4aabac30d178cae31ca397d4
WARNING: no policy specified for oryx/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab.
Entry for principal oryx/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab.
I20260808 14:56:58.397583 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:35697
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab
--principal=oryx/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:58.758527 25866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:58.758876 25866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:58.759055 25866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:58.766388 25866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:58.766538 25866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:58.766687 25866 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:56:58.766829 25866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:56:58.776610 25866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab
--principal=oryx/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.73.190:35697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:58.778038 25866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:58.779533 25866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:56:58.794201 25876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:58.794133 25883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:58.794431 25875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:58.795104 25866 server_base.cc:1034] running on GCE node
I20260808 14:56:58.795763 25866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:58.796687 25866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:58.797915 25866 hybrid_clock.cc:648] HybridClock initialized: now 1786201018797832 us; error 55 us; skew 500 ppm
I20260808 14:56:58.798235 25866 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:58 dist-test-slave-z8x9 krb5kdc[25470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201018, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:58.801545 25866 init.cc:377] Logged in from keytab as oryx/127.12.73.130@KRBTEST.COM (short username oryx)
I20260808 14:56:58.802987 25866 webserver.cc:460] Webserver started at http://127.12.73.130:43329/ using document root <none> and password file <none>
I20260808 14:56:58.803699 25866 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:58.803825 25866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:58.804198 25866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:58.807169 25866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "84a66f0cbb1d48419e68287df27a98e5"
format_stamp: "Formatted at 2026-08-08 14:56:58 on dist-test-slave-z8x9"
server_key: "cce0275009379b8d96f2817193912407"
server_key_iv: "4c1144406107a4833fc60285affe2412"
server_key_version: "encryptionkey@0"
I20260808 14:56:58.807981 25866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "84a66f0cbb1d48419e68287df27a98e5"
format_stamp: "Formatted at 2026-08-08 14:56:58 on dist-test-slave-z8x9"
server_key: "cce0275009379b8d96f2817193912407"
server_key_iv: "4c1144406107a4833fc60285affe2412"
server_key_version: "encryptionkey@0"
I20260808 14:56:58.812988 25866 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:56:58.816555 25893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:58.817952 25866 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:56:58.818153 25866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "84a66f0cbb1d48419e68287df27a98e5"
format_stamp: "Formatted at 2026-08-08 14:56:58 on dist-test-slave-z8x9"
server_key: "cce0275009379b8d96f2817193912407"
server_key_iv: "4c1144406107a4833fc60285affe2412"
server_key_version: "encryptionkey@0"
I20260808 14:56:58.818404 25866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:58.837745 25866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:58.841635 25866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:58.841924 25866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:58.844547 25866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:58.844681 25866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:58.844858 25866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:58.844920 25866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:56:58 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201018, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:56:58.872611 25912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:58.845837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:35697 (local address 127.12.73.130:59879)
0808 14:56:58.846728 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:58.846774 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:58.848806 (+ 2032us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:58.849694 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:58.849709 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:58.850459 (+ 750us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:58.851314 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:58.851353 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.853267 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.853279 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:58.855846 (+ 2567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:58.855860 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.856837 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.856846 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:58.857293 (+ 447us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:58.858259 (+ 966us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:58.858304 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:58.862543 (+ 4239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:58.866549 (+ 4006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:58.866562 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:58.866580 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:58.867382 (+ 802us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:58.867941 (+ 559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:58.867945 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:58.867947 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:58.868250 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:58.869065 (+ 815us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:58.869073 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:58.869639 (+ 566us) client_negotiation.cc:769] Sending connection context
0808 14:56:58.870047 (+ 408us) client_negotiation.cc:240] Negotiation successful
0808 14:56:58.870715 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":388,"threads_started":1}
I20260808 14:56:58.874010 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:58.845279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:59879 (local address 127.12.73.190:35697)
0808 14:56:58.845784 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:58.845792 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:58.846925 (+ 1133us) server_negotiation.cc:407] Connection header received
0808 14:56:58.849139 (+ 2214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:58.849147 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:58.849287 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:58.849421 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:58.851563 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.852978 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.856042 (+ 3064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.856538 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.856713 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:58.862844 (+ 6131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:58.862855 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:58.862860 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:58.862911 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:58.866394 (+ 3483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:58.867574 (+ 1180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:58.867583 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:58.867589 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:58.867805 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:58.868411 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:58.868418 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:58.868440 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:58.868887 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:58.869078 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:58.873462 (+ 4384us) server_negotiation.cc:299] Negotiation successful
0808 14:56:58.873731 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":247,"threads_started":1}
I20260808 14:56:58.899272 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:58.883768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:48861 (local address 127.12.73.190:35697)
0808 14:56:58.883974 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:58.883983 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:58.885082 (+ 1099us) server_negotiation.cc:407] Connection header received
0808 14:56:58.885425 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:58.885431 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:58.885524 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:58.885662 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:58.886997 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.887690 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.889019 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.889487 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.889655 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:58.892468 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:58.892473 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:58.892476 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:58.892505 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:58.896018 (+ 3513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:58.896863 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:58.896872 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:58.896874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:58.896989 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:58.897493 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:58.897499 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:58.897503 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:58.897994 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:58.898152 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:58.898672 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 14:56:58.898911 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:56:58.899382 26021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:58.883680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:35697 (local address 127.12.73.130:48861)
0808 14:56:58.884969 (+ 1289us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:58.884988 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:58.885155 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:58.885707 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:58.885713 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:58.886411 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:58.886839 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:58.886851 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.887845 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.887852 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:58.888872 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:58.888884 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:58.889765 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:58.889775 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:58.890031 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:58.890821 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:58.890878 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:58.892273 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:58.896147 (+ 3874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:58.896151 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:58.896153 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:58.896678 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:58.897110 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:58.897115 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:58.897120 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:58.897328 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:58.898121 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:58.898125 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:58.898374 (+ 249us) client_negotiation.cc:769] Sending connection context
0808 14:56:58.898547 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 14:56:58.898920 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1165,"thread_start_us":1026,"threads_started":1}
I20260808 14:56:58.907642 25866 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:36183
I20260808 14:56:58.907672 26077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:36183 every 8 connection(s)
I20260808 14:56:58.908803 25866 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:56:58.910746 26079 heartbeater.cc:347] Connected to a master server at 127.12.73.190:35697
I20260808 14:56:58.910983 26079 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:58.911592 26079 heartbeater.cc:511] Master 127.12.73.190:35697 requested a full tablet report, sending...
I20260808 14:56:58.912854 25547 ts_manager.cc:194] Registered new tserver with Master: 84a66f0cbb1d48419e68287df27a98e5 (127.12.73.130:36183)
I20260808 14:56:58.913715 25547 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:59879
I20260808 14:56:58.916078 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 25866
I20260808 14:56:58.916270 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:56:58.916729 12582 external_mini_cluster.cc:1428] Setting key e6ca0d7a231db1a7bcd8ab5bb9bb0e2d
WARNING: no policy specified for oryx/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab.
Entry for principal oryx/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab.
I20260808 14:56:58.973111 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:35697
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab
--principal=oryx/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:56:59.306227 26088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:56:59.306502 26088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:56:59.306677 26088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:56:59.313728 26088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:56:59.313871 26088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:56:59.314033 26088 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:56:59.314180 26088 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:56:59.325089 26088 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab
--principal=oryx/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.73.190:35697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:56:59.326663 26088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:56:59.328336 26088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:56:59.334661 25859 heartbeater.cc:503] Master 127.12.73.190:35697 was elected leader, sending a full tablet report...
W20260808 14:56:59.341866 26096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:59.341962 26095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:56:59.341918 26100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:56:59.342763 26088 server_base.cc:1034] running on GCE node
I20260808 14:56:59.343312 26088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:56:59.344137 26088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:56:59.345331 26088 hybrid_clock.cc:648] HybridClock initialized: now 1786201019345261 us; error 53 us; skew 500 ppm
I20260808 14:56:59.345631 26088 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:56:59 dist-test-slave-z8x9 krb5kdc[25470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201019, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:56:59.348907 26088 init.cc:377] Logged in from keytab as oryx/127.12.73.131@KRBTEST.COM (short username oryx)
I20260808 14:56:59.350368 26088 webserver.cc:460] Webserver started at http://127.12.73.131:41141/ using document root <none> and password file <none>
I20260808 14:56:59.351071 26088 fs_manager.cc:359] Metadata directory not provided
I20260808 14:56:59.351190 26088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:56:59.351531 26088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:56:59.354508 26088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "bb9f7814639c45fc81d1fc551ac6b5ea"
format_stamp: "Formatted at 2026-08-08 14:56:59 on dist-test-slave-z8x9"
server_key: "a85fcc3183c9ff6dc6fae02898eab1b0"
server_key_iv: "4175863d3eed5d71750eb2b34e8a5d43"
server_key_version: "encryptionkey@0"
I20260808 14:56:59.355309 26088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "bb9f7814639c45fc81d1fc551ac6b5ea"
format_stamp: "Formatted at 2026-08-08 14:56:59 on dist-test-slave-z8x9"
server_key: "a85fcc3183c9ff6dc6fae02898eab1b0"
server_key_iv: "4175863d3eed5d71750eb2b34e8a5d43"
server_key_version: "encryptionkey@0"
I20260808 14:56:59.360360 26088 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 14:56:59.363660 26112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:59.364876 26088 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:56:59.365046 26088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "bb9f7814639c45fc81d1fc551ac6b5ea"
format_stamp: "Formatted at 2026-08-08 14:56:59 on dist-test-slave-z8x9"
server_key: "a85fcc3183c9ff6dc6fae02898eab1b0"
server_key_iv: "4175863d3eed5d71750eb2b34e8a5d43"
server_key_version: "encryptionkey@0"
I20260808 14:56:59.365337 26088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:56:59.380874 26088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:56:59.385330 26088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:56:59.385645 26088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:56:59.388195 26088 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:56:59.388310 26088 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:56:59.388481 26088 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:56:59.388582 26088 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:56:59 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201019, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:56:59.412755 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:59.388992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:60317 (local address 127.12.73.190:35697)
0808 14:56:59.389249 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:59.389256 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:59.390720 (+ 1464us) server_negotiation.cc:407] Connection header received
0808 14:56:59.393806 (+ 3086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:59.393812 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:59.393902 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:59.394029 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:59.396391 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:59.397581 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:59.399730 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:59.400209 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:59.400366 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:59.405301 (+ 4935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:59.405308 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:59.405313 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:59.405353 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:59.408869 (+ 3516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:59.409972 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:59.409981 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:59.409984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:59.410148 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:59.410714 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:59.410720 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:59.410723 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:59.411117 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:59.411291 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:59.412135 (+ 844us) server_negotiation.cc:299] Negotiation successful
0808 14:56:59.412366 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 14:56:59.414143 26125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:59.389559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:35697 (local address 127.12.73.131:60317)
0808 14:56:59.390520 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:59.390592 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:59.393421 (+ 2829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:59.394309 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:59.394324 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:59.395169 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:59.396208 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:59.396229 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:59.397789 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:59.397795 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:59.399522 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:59.399534 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:59.400479 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:59.400487 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:59.400695 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:59.401477 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:59.401499 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:59.404977 (+ 3478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:59.409036 (+ 4059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:59.409044 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:59.409063 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:59.409806 (+ 743us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:59.410269 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:59.410280 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:59.410286 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:59.410596 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:59.411366 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:59.411373 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:59.411724 (+ 351us) client_negotiation.cc:769] Sending connection context
0808 14:56:59.412025 (+ 301us) client_negotiation.cc:240] Negotiation successful
0808 14:56:59.412627 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":411,"threads_started":1}
I20260808 14:56:59.435212 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:59.419997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:45111 (local address 127.12.73.190:35697)
0808 14:56:59.420175 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:59.420183 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:59.421028 (+ 845us) server_negotiation.cc:407] Connection header received
0808 14:56:59.421267 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:59.421272 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:59.421346 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:59.421448 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:59.423035 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:59.423908 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:59.425351 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:59.426019 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:59.426152 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:59.428823 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:56:59.428833 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:56:59.428839 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:56:59.428888 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:56:59.432240 (+ 3352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:59.433158 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:59.433190 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:59.433196 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:59.433343 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:56:59.433745 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:56:59.433751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:56:59.433756 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:56:59.434035 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:56:59.434193 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:56:59.434598 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 14:56:59.434831 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:56:59.435325 26237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:56:59.420110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:35697 (local address 127.12.73.131:45111)
0808 14:56:59.420921 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0808 14:56:59.420938 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:56:59.421101 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:56:59.421477 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:56:59.421481 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:56:59.422260 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:56:59.422816 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:59.422837 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:59.424053 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:59.424058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:59.425119 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:56:59.425131 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:56:59.426269 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:56:59.426287 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:56:59.426548 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:56:59.427337 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:56:59.427366 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:56:59.428554 (+ 1188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:56:59.432370 (+ 3816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:59.432374 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:59.432379 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:59.433014 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:59.433465 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:56:59.433473 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:56:59.433477 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:56:59.433614 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:56:59.434159 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:56:59.434164 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:56:59.434351 (+ 187us) client_negotiation.cc:769] Sending connection context
0808 14:56:59.434505 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 14:56:59.434836 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":540,"threads_started":1}
I20260808 14:56:59.444602 26088 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:44111
I20260808 14:56:59.444623 26314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:44111 every 8 connection(s)
I20260808 14:56:59.445865 26088 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:56:59.447921 26315 heartbeater.cc:347] Connected to a master server at 127.12.73.190:35697
I20260808 14:56:59.448110 26315 heartbeater.cc:464] Registering TS with master...
I20260808 14:56:59.448680 26315 heartbeater.cc:511] Master 127.12.73.190:35697 requested a full tablet report, sending...
I20260808 14:56:59.450039 25547 ts_manager.cc:194] Registered new tserver with Master: bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111)
I20260808 14:56:59.450816 25547 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:60317
I20260808 14:56:59.451042 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 26088
I20260808 14:56:59.451288 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:56:59.451807 12582 external_mini_cluster.cc:1428] Setting key 8275e61ba9e3d547ecd0ca02b2c09b9a
I20260808 14:56:59.454752 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:56:59 dist-test-slave-z8x9 krb5kdc[25470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201019, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:56:59 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:56:59 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:56:59.916152 26079 heartbeater.cc:503] Master 127.12.73.190:35697 was elected leader, sending a full tablet report...
I20260808 14:57:00.453701 26315 heartbeater.cc:503] Master 127.12.73.190:35697 was elected leader, sending a full tablet report...
W20260808 14:57:00.617332 26332 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.108s user 0.007s sys 0.014s
W20260808 14:57:00.618660 25911 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:56:59.503256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50878 (local address 127.12.73.190:35697)
0808 14:56:59.503504 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:56:59.503510 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:56:59.503716 (+ 206us) server_negotiation.cc:407] Connection header received
0808 14:56:59.503940 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:56:59.503945 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:56:59.504010 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:56:59.504117 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:56:59.505532 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:59.506273 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:59.507492 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:56:59.507899 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:56:59.508040 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.618317 (+1110277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50878: BlockingRecv error: recv got EOF from 127.0.0.1:50878 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 08 14:57:00 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201019, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:57:00.642134 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:00.622932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50890 (local address 127.12.73.190:35697)
0808 14:57:00.623173 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:00.623180 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:00.623393 (+ 213us) server_negotiation.cc:407] Connection header received
0808 14:57:00.623526 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:00.623529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:00.623593 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:00.623677 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:00.625008 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.625904 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.627115 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.627526 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.627616 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.637256 (+ 9640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:00.637261 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:00.637264 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:00.637296 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:00.639708 (+ 2412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:00.640350 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:00.640353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:00.640355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:00.640478 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:00.640875 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:00.640878 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:00.640880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:00.641133 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:00.641346 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:00.641626 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 14:57:00.641787 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 14:57:00.646267 25547 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50890:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:57:00.653625 25547 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:57:00.685353 26357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:00.667832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44012 (local address 127.12.73.130:36183)
0808 14:57:00.673761 (+ 5929us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:00.673774 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:00.674506 (+ 732us) server_negotiation.cc:407] Connection header received
0808 14:57:00.674865 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:00.674878 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:00.675292 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:00.675506 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:57:00.676818 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.678911 (+ 2093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.682221 (+ 3310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.683771 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.683877 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.684055 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:00.684834 (+ 779us) server_negotiation.cc:299] Negotiation successful
0808 14:57:00.685017 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5713,"thread_start_us":5552,"threads_started":1}
I20260808 14:57:00.685477 26355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:00.667465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:36183 (local address 127.0.0.1:44012)
0808 14:57:00.674356 (+ 6891us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:00.674382 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:00.674642 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:00.675876 (+ 1234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:00.675884 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:00.675916 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:57:00.676586 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:00.676604 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.679220 (+ 2616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.679229 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:00.682038 (+ 2809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:00.682053 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.684288 (+ 2235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.684296 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:00.684602 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.684640 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:57:00.684790 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 14:57:00.684992 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6667,"mutex_wait_us":88,"thread_start_us":6489,"threads_started":1}
I20260808 14:57:00.688037 26356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:00.667482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47498 (local address 127.12.73.131:44111)
0808 14:57:00.679991 (+ 12509us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:00.679999 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:00.680034 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:57:00.680137 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:00.680145 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:00.680436 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:00.681286 (+ 850us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:57:00.681494 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.683007 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.685909 (+ 2902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.687025 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.687225 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.687433 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:00.687592 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 14:57:00.687752 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12353,"thread_start_us":12222,"threads_started":1}
I20260808 14:57:00.688385 26354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:00.667304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:44111 (local address 127.0.0.1:47498)
0808 14:57:00.668219 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:00.668278 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:00.668492 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:00.680683 (+ 12191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:00.680688 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:00.680718 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:57:00.681208 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:00.681220 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.683158 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.683163 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:00.685517 (+ 2354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:00.685532 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.687246 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.687252 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:00.687410 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.687443 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 14:57:00.687538 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 14:57:00.687667 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"mutex_wait_us":1,"thread_start_us":727,"threads_started":1}
I20260808 14:57:00.689476 26359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:00.674292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44453 (local address 127.0.0.1:39388)
0808 14:57:00.680761 (+ 6469us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:00.680789 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:00.680930 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:00.681636 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:00.681640 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:00.681665 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:57:00.682053 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:00.682063 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.683441 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.683448 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:00.686152 (+ 2704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:00.686166 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.688696 (+ 2530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.688703 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:00.688873 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.688905 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 14:57:00.688987 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 14:57:00.689102 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6291,"mutex_wait_us":61,"thread_start_us":5281,"threads_started":1}
I20260808 14:57:00.690042 26360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:00.674627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39388 (local address 127.12.73.129:44453)
0808 14:57:00.679439 (+ 4812us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:00.679450 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:00.680916 (+ 1466us) server_negotiation.cc:407] Connection header received
0808 14:57:00.681211 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:00.681219 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:00.681451 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:00.681647 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:57:00.682223 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.683271 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.686312 (+ 3041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.688284 (+ 1972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.688422 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.689432 (+ 1010us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:00.689486 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 14:57:00.689827 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4633,"thread_start_us":4474,"threads_started":1}
I20260808 14:57:00.689742 25972 tablet_service.cc:1467] Processing CreateTablet for tablet 40b4d4d07bee45b9bee968d9affdc333 (DEFAULT_TABLE table=test-table [id=706fdc49b0a14d08bbb3d58f429f98c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:00.691807 25972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40b4d4d07bee45b9bee968d9affdc333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:00.693105 25763 tablet_service.cc:1467] Processing CreateTablet for tablet 40b4d4d07bee45b9bee968d9affdc333 (DEFAULT_TABLE table=test-table [id=706fdc49b0a14d08bbb3d58f429f98c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:00.694347 25763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40b4d4d07bee45b9bee968d9affdc333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:00.695627 26200 tablet_service.cc:1467] Processing CreateTablet for tablet 40b4d4d07bee45b9bee968d9affdc333 (DEFAULT_TABLE table=test-table [id=706fdc49b0a14d08bbb3d58f429f98c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:00.696923 26200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40b4d4d07bee45b9bee968d9affdc333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:00.706267 26361 tablet_bootstrap.cc:492] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2: Bootstrap starting.
I20260808 14:57:00.707155 26362 tablet_bootstrap.cc:492] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5: Bootstrap starting.
I20260808 14:57:00.710597 26361 tablet_bootstrap.cc:654] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:00.710597 26362 tablet_bootstrap.cc:654] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:00.711004 26365 tablet_bootstrap.cc:492] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea: Bootstrap starting.
I20260808 14:57:00.711977 26361 log.cc:824] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:57:00.711977 26362 log.cc:824] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:57:00.714510 26365 tablet_bootstrap.cc:654] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:00.715114 26361 tablet_bootstrap.cc:492] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2: No bootstrap required, opened a new log
I20260808 14:57:00.715409 26361 ts_tablet_manager.cc:1397] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 14:57:00.715665 26362 tablet_bootstrap.cc:492] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5: No bootstrap required, opened a new log
I20260808 14:57:00.715895 26365 log.cc:824] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea: Log is configured to *not* fsync() on all Append() calls
I20260808 14:57:00.716044 26362 ts_tablet_manager.cc:1397] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260808 14:57:00.718870 26365 tablet_bootstrap.cc:492] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea: No bootstrap required, opened a new log
I20260808 14:57:00.719127 26365 ts_tablet_manager.cc:1397] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 14:57:00.723902 26361 raft_consensus.cc:348] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } }
I20260808 14:57:00.724395 26361 raft_consensus.cc:374] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:00.724522 26361 raft_consensus.cc:729] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a1103a37cf43daa606eac2a688bdd2, State: Initialized, Role: FOLLOWER
I20260808 14:57:00.725281 26361 consensus_queue.cc:260] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } }
I20260808 14:57:00.726660 26362 raft_consensus.cc:348] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } }
I20260808 14:57:00.727015 26361 ts_tablet_manager.cc:1428] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2: Time spent starting tablet: real 0.011s user 0.007s sys 0.005s
I20260808 14:57:00.727057 26362 raft_consensus.cc:374] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:00.727141 26362 raft_consensus.cc:729] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84a66f0cbb1d48419e68287df27a98e5, State: Initialized, Role: FOLLOWER
I20260808 14:57:00.727681 26362 consensus_queue.cc:260] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } }
I20260808 14:57:00.729290 26362 ts_tablet_manager.cc:1428] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260808 14:57:00.730018 26365 raft_consensus.cc:348] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } }
I20260808 14:57:00.730466 26365 raft_consensus.cc:374] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:00.730583 26365 raft_consensus.cc:729] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb9f7814639c45fc81d1fc551ac6b5ea, State: Initialized, Role: FOLLOWER
I20260808 14:57:00.731171 26365 consensus_queue.cc:260] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } }
I20260808 14:57:00.732615 26365 ts_tablet_manager.cc:1428] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260808 14:57:00.817190 26371 raft_consensus.cc:482] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:57:00.817539 26371 raft_consensus.cc:504] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } }
I20260808 14:57:00.819389 26371 leader_election.cc:288] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111), 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453)
I20260808 14:57:00.826392 26360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:00.820379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:54747 (local address 127.12.73.129:44453)
0808 14:57:00.820611 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:00.820618 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:00.820844 (+ 226us) server_negotiation.cc:407] Connection header received
0808 14:57:00.821064 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:00.821068 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:00.821126 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:00.821264 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:57:00.821986 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.822696 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.824622 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.825452 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.825643 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.825716 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:00.826014 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 14:57:00.826137 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:57:00.826639 26375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:00.819801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44453 (local address 127.12.73.130:54747)
0808 14:57:00.820737 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:00.820755 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:00.820914 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:00.821282 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:00.821287 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:00.821326 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:57:00.821840 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:00.821851 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.822834 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.822851 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:00.824453 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:00.824465 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.825660 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.825666 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:00.825848 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.825872 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:57:00.825992 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 14:57:00.826125 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":808,"mutex_wait_us":51,"thread_start_us":607,"threads_started":1}
I20260808 14:57:00.826771 26356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:00.819786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:59993 (local address 127.12.73.131:44111)
0808 14:57:00.820058 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:00.820066 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:00.820626 (+ 560us) server_negotiation.cc:407] Connection header received
0808 14:57:00.820923 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:00.820928 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:00.821019 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:00.821127 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:57:00.821786 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.822619 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.824724 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.825807 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.825978 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.826061 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:00.826369 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 14:57:00.826502 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260808 14:57:00.826930 26374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:00.819571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:44111 (local address 127.12.73.130:59993)
0808 14:57:00.820504 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:00.820533 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:00.820754 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:00.821144 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:00.821149 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:00.821210 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:57:00.821608 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:00.821621 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.822779 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.822784 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:00.824563 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:00.824577 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.826049 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.826055 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:00.826204 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.826227 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:57:00.826332 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 14:57:00.826457 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":782,"mutex_wait_us":1,"thread_start_us":415,"threads_started":1}
I20260808 14:57:00.827950 26238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b4d4d07bee45b9bee968d9affdc333" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" is_pre_election: true
I20260808 14:57:00.827950 25791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b4d4d07bee45b9bee968d9affdc333" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a1103a37cf43daa606eac2a688bdd2" is_pre_election: true
I20260808 14:57:00.828547 25791 raft_consensus.cc:2454] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 0.
I20260808 14:57:00.828547 26238 raft_consensus.cc:2454] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 0.
W20260808 14:57:00.828857 25860 tablet.cc:2369] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:57:00.829293 25895 leader_election.cc:302] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84a66f0cbb1d48419e68287df27a98e5, bb9f7814639c45fc81d1fc551ac6b5ea; no voters:
I20260808 14:57:00.829744 26371 raft_consensus.cc:2781] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:57:00.829877 26371 raft_consensus.cc:482] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:57:00.829954 26371 raft_consensus.cc:3037] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:00.832070 26371 raft_consensus.cc:504] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } }
I20260808 14:57:00.832625 26371 leader_election.cc:288] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 election: Requested vote from peers bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111), 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453)
I20260808 14:57:00.832930 26238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b4d4d07bee45b9bee968d9affdc333" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea"
I20260808 14:57:00.833124 26238 raft_consensus.cc:3037] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:00.833088 25791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b4d4d07bee45b9bee968d9affdc333" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a1103a37cf43daa606eac2a688bdd2"
I20260808 14:57:00.833308 25791 raft_consensus.cc:3037] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:00.835270 26238 raft_consensus.cc:2454] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 1.
I20260808 14:57:00.835522 25791 raft_consensus.cc:2454] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 1.
I20260808 14:57:00.835646 25895 leader_election.cc:302] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84a66f0cbb1d48419e68287df27a98e5, bb9f7814639c45fc81d1fc551ac6b5ea; no voters:
I20260808 14:57:00.835917 26371 raft_consensus.cc:2781] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:57:00.836401 26371 raft_consensus.cc:686] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 LEADER]: Becoming Leader. State: Replica: 84a66f0cbb1d48419e68287df27a98e5, State: Running, Role: LEADER
I20260808 14:57:00.836942 26371 consensus_queue.cc:237] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } }
I20260808 14:57:00.841289 25545 catalog_manager.cc:5495] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84a66f0cbb1d48419e68287df27a98e5 (127.12.73.130). New cstate: current_term: 1 leader_uuid: "84a66f0cbb1d48419e68287df27a98e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } health_report { overall_health: UNKNOWN } } }
I20260808 14:57:00.886744 26357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:00.881469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44016 (local address 127.12.73.130:36183)
0808 14:57:00.881705 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:00.881709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:00.881728 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:57:00.881915 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:00.881918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:00.881996 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:00.882130 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:57:00.882455 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.883115 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.884597 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:00.884975 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:00.885068 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:00.885638 (+ 570us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:57:00.886153 (+ 515us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:57:00.886258 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:00.886380 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 14:57:00.886440 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 14:57:00.894876 25791 raft_consensus.cc:1261] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Refusing update from remote peer 84a66f0cbb1d48419e68287df27a98e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:57:00.894958 26238 raft_consensus.cc:1261] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Refusing update from remote peer 84a66f0cbb1d48419e68287df27a98e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:57:00.895962 26371 consensus_queue.cc:1035] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:57:00.896282 26378 consensus_queue.cc:1035] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:57:00.908710 26383 mvcc.cc:205] Tried to move back new op lower bound from 7316279381575946240 to 7316279381352054784. Current Snapshot: MvccSnapshot[applied={T|T < 7316279381575946240}]
I20260808 14:57:00.909325 26384 mvcc.cc:205] Tried to move back new op lower bound from 7316279381575946240 to 7316279381352054784. Current Snapshot: MvccSnapshot[applied={T|T < 7316279381575946240}]
I20260808 14:57:00.934716 25545 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:57:00.935004 25545 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:57:00.938445 25545 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55: Sending DeleteTablet for 3 replicas of tablet 40b4d4d07bee45b9bee968d9affdc333
I20260808 14:57:00.939520 26200 tablet_service.cc:1514] Processing DeleteTablet for tablet 40b4d4d07bee45b9bee968d9affdc333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:00 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:47498
I20260808 14:57:00.939632 25972 tablet_service.cc:1514] Processing DeleteTablet for tablet 40b4d4d07bee45b9bee968d9affdc333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:00 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:44012
I20260808 14:57:00.939669 25763 tablet_service.cc:1514] Processing DeleteTablet for tablet 40b4d4d07bee45b9bee968d9affdc333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:00 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:39388
I20260808 14:57:00.941047 26401 tablet_replica.cc:330] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5: stopping tablet replica
I20260808 14:57:00.941629 26401 raft_consensus.cc:2229] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:57:00.941591 25545 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50890:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:57:00.942412 25545 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:57:00.942764 26401 raft_consensus.cc:2258] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:00.945232 26401 ts_tablet_manager.cc:1905] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:00.945892 26402 tablet_replica.cc:330] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea: stopping tablet replica
I20260808 14:57:00.946076 26403 tablet_replica.cc:330] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2: stopping tablet replica
I20260808 14:57:00.946408 26402 raft_consensus.cc:2229] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:57:00.946506 26403 raft_consensus.cc:2229] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:57:00.947009 26403 raft_consensus.cc:2258] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:00.947485 26402 raft_consensus.cc:2258] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:00.949420 26403 ts_tablet_manager.cc:1905] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:00.950519 26402 ts_tablet_manager.cc:1905] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:00.950991 26200 tablet_service.cc:1467] Processing CreateTablet for tablet 6039d35da436412386a23b0cbc60e7f1 (DEFAULT_TABLE table=test-table [id=5f7b0eb594094f069897bedc9297ac59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:00.951417 26200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6039d35da436412386a23b0cbc60e7f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:00.955397 26401 ts_tablet_manager.cc:1918] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:57:00.955576 26401 log.cc:1196] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/40b4d4d07bee45b9bee968d9affdc333
I20260808 14:57:00.956130 26401 ts_tablet_manager.cc:1939] T 40b4d4d07bee45b9bee968d9affdc333 P 84a66f0cbb1d48419e68287df27a98e5: Deleting consensus metadata
I20260808 14:57:00.958180 25518 catalog_manager.cc:4841] TS 84a66f0cbb1d48419e68287df27a98e5 (127.12.73.130:36183): tablet 40b4d4d07bee45b9bee968d9affdc333 (table test-table [id=706fdc49b0a14d08bbb3d58f429f98c4]) successfully deleted
I20260808 14:57:00.958438 26402 ts_tablet_manager.cc:1918] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:57:00.958667 26402 log.cc:1196] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/40b4d4d07bee45b9bee968d9affdc333
I20260808 14:57:00.958570 25972 tablet_service.cc:1467] Processing CreateTablet for tablet 6039d35da436412386a23b0cbc60e7f1 (DEFAULT_TABLE table=test-table [id=5f7b0eb594094f069897bedc9297ac59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:00.959022 25972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6039d35da436412386a23b0cbc60e7f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:00.959209 25763 tablet_service.cc:1467] Processing CreateTablet for tablet 6039d35da436412386a23b0cbc60e7f1 (DEFAULT_TABLE table=test-table [id=5f7b0eb594094f069897bedc9297ac59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:00.959558 26402 ts_tablet_manager.cc:1939] T 40b4d4d07bee45b9bee968d9affdc333 P bb9f7814639c45fc81d1fc551ac6b5ea: Deleting consensus metadata
I20260808 14:57:00.959707 25763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6039d35da436412386a23b0cbc60e7f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:00.959992 26365 tablet_bootstrap.cc:492] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea: Bootstrap starting.
I20260808 14:57:00.961470 25514 catalog_manager.cc:4841] TS bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111): tablet 40b4d4d07bee45b9bee968d9affdc333 (table test-table [id=706fdc49b0a14d08bbb3d58f429f98c4]) successfully deleted
I20260808 14:57:00.961671 26365 tablet_bootstrap.cc:654] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:00.964123 26365 tablet_bootstrap.cc:492] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea: No bootstrap required, opened a new log
I20260808 14:57:00.964267 26365 ts_tablet_manager.cc:1397] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 14:57:00.965034 26365 raft_consensus.cc:348] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:00.965284 26365 raft_consensus.cc:374] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:00.965418 26365 raft_consensus.cc:729] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb9f7814639c45fc81d1fc551ac6b5ea, State: Initialized, Role: FOLLOWER
I20260808 14:57:00.965808 26361 tablet_bootstrap.cc:492] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2: Bootstrap starting.
I20260808 14:57:00.965883 26362 tablet_bootstrap.cc:492] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5: Bootstrap starting.
I20260808 14:57:00.965687 26365 consensus_queue.cc:260] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:00.967196 26365 ts_tablet_manager.cc:1428] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:57:00.967473 26362 tablet_bootstrap.cc:654] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:00.967626 26361 tablet_bootstrap.cc:654] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:00.969321 26403 ts_tablet_manager.cc:1918] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:57:00.969494 26403 log.cc:1196] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/40b4d4d07bee45b9bee968d9affdc333
I20260808 14:57:00.970122 26403 ts_tablet_manager.cc:1939] T 40b4d4d07bee45b9bee968d9affdc333 P 75a1103a37cf43daa606eac2a688bdd2: Deleting consensus metadata
I20260808 14:57:00.970954 26361 tablet_bootstrap.cc:492] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2: No bootstrap required, opened a new log
I20260808 14:57:00.971122 26361 ts_tablet_manager.cc:1397] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260808 14:57:00.971920 26362 tablet_bootstrap.cc:492] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5: No bootstrap required, opened a new log
I20260808 14:57:00.972041 25518 catalog_manager.cc:4841] TS 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453): tablet 40b4d4d07bee45b9bee968d9affdc333 (table test-table [id=706fdc49b0a14d08bbb3d58f429f98c4]) successfully deleted
I20260808 14:57:00.972131 26362 ts_tablet_manager.cc:1397] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260808 14:57:00.972168 26361 raft_consensus.cc:348] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:00.972417 26361 raft_consensus.cc:374] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:00.972530 26361 raft_consensus.cc:729] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a1103a37cf43daa606eac2a688bdd2, State: Initialized, Role: FOLLOWER
I20260808 14:57:00.972784 26361 consensus_queue.cc:260] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:00.973194 26362 raft_consensus.cc:348] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:00.973537 26361 ts_tablet_manager.cc:1428] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 14:57:00.973425 26362 raft_consensus.cc:374] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:00.974198 26362 raft_consensus.cc:729] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84a66f0cbb1d48419e68287df27a98e5, State: Initialized, Role: FOLLOWER
I20260808 14:57:00.974859 26362 consensus_queue.cc:260] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:00.975421 26362 ts_tablet_manager.cc:1428] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260808 14:57:01.030579 26392 raft_consensus.cc:482] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:57:01.030836 26392 raft_consensus.cc:504] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.031762 26392 leader_election.cc:288] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453), bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111)
I20260808 14:57:01.032325 26238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6039d35da436412386a23b0cbc60e7f1" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" is_pre_election: true
I20260808 14:57:01.032362 25791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6039d35da436412386a23b0cbc60e7f1" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a1103a37cf43daa606eac2a688bdd2" is_pre_election: true
I20260808 14:57:01.032600 26238 raft_consensus.cc:2454] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 0.
I20260808 14:57:01.032627 25791 raft_consensus.cc:2454] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 0.
I20260808 14:57:01.033074 25898 leader_election.cc:302] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a1103a37cf43daa606eac2a688bdd2, 84a66f0cbb1d48419e68287df27a98e5; no voters:
I20260808 14:57:01.033411 26392 raft_consensus.cc:2781] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:57:01.033546 26392 raft_consensus.cc:482] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:57:01.033641 26392 raft_consensus.cc:3037] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:01.036921 26392 raft_consensus.cc:504] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.037599 26392 leader_election.cc:288] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 election: Requested vote from peers 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453), bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111)
I20260808 14:57:01.038079 26238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6039d35da436412386a23b0cbc60e7f1" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea"
I20260808 14:57:01.038100 25791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6039d35da436412386a23b0cbc60e7f1" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a1103a37cf43daa606eac2a688bdd2"
I20260808 14:57:01.038304 26238 raft_consensus.cc:3037] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:01.038306 25791 raft_consensus.cc:3037] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:01.040616 26238 raft_consensus.cc:2454] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 1.
I20260808 14:57:01.041071 25895 leader_election.cc:302] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84a66f0cbb1d48419e68287df27a98e5, bb9f7814639c45fc81d1fc551ac6b5ea; no voters:
I20260808 14:57:01.041298 25791 raft_consensus.cc:2454] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 1.
I20260808 14:57:01.041381 26392 raft_consensus.cc:2781] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:57:01.041599 26392 raft_consensus.cc:686] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 LEADER]: Becoming Leader. State: Replica: 84a66f0cbb1d48419e68287df27a98e5, State: Running, Role: LEADER
I20260808 14:57:01.041924 26392 consensus_queue.cc:237] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.044602 25547 catalog_manager.cc:5495] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84a66f0cbb1d48419e68287df27a98e5 (127.12.73.130). New cstate: current_term: 1 leader_uuid: "84a66f0cbb1d48419e68287df27a98e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } health_report { overall_health: UNKNOWN } } }
Aug 08 14:57:01 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201017, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.190@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:57:01.106787 26421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:01.087427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:35697 (local address 127.0.0.1:50902)
0808 14:57:01.088091 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:01.088110 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:01.088303 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:01.088792 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:01.088797 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:01.089810 (+ 1013us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:01.090162 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:01.090173 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.091413 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.091421 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:01.093275 (+ 1854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:01.093294 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.094385 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.094395 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:01.094657 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.095505 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:01.095527 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:01.098953 (+ 3426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:01.103090 (+ 4137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:01.103106 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:01.103115 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:01.103833 (+ 718us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:01.104316 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:01.104324 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:01.104328 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:01.104540 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:01.105243 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:01.105254 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:01.105507 (+ 253us) client_negotiation.cc:769] Sending connection context
0808 14:57:01.105754 (+ 247us) client_negotiation.cc:240] Negotiation successful
0808 14:57:01.106134 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":371,"threads_started":1}
I20260808 14:57:01.106813 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:01.086987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50902 (local address 127.12.73.190:35697)
0808 14:57:01.087190 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:01.087196 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:01.088208 (+ 1012us) server_negotiation.cc:407] Connection header received
0808 14:57:01.088426 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:01.088431 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:01.088514 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:01.088603 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:01.090309 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.091239 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.093443 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.094134 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.094283 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.099166 (+ 4883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:01.099173 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:01.099179 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:01.099216 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:01.102934 (+ 3718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:01.104015 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:01.104022 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:01.104026 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:01.104184 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:01.104669 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:01.104674 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:01.104677 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:01.105040 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:01.105240 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:01.105877 (+ 637us) server_negotiation.cc:299] Negotiation successful
0808 14:57:01.106315 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":159,"server-negotiator.queue_time_us":75}
I20260808 14:57:01.112679 25547 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:50902:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:57:01.113754 25547 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:57:01.120563 25763 tablet_service.cc:1467] Processing CreateTablet for tablet 5125686e62d84a8f99dfb50bf5b6e572 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c5c0111e2b4b44409ca7a6333ed17dd2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:57:01.121238 25763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5125686e62d84a8f99dfb50bf5b6e572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:01.121187 26200 tablet_service.cc:1467] Processing CreateTablet for tablet 5125686e62d84a8f99dfb50bf5b6e572 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c5c0111e2b4b44409ca7a6333ed17dd2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:57:01.121241 25972 tablet_service.cc:1467] Processing CreateTablet for tablet 5125686e62d84a8f99dfb50bf5b6e572 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c5c0111e2b4b44409ca7a6333ed17dd2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:57:01.121775 26200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5125686e62d84a8f99dfb50bf5b6e572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:01.121765 25972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5125686e62d84a8f99dfb50bf5b6e572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:01.128479 26361 tablet_bootstrap.cc:492] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2: Bootstrap starting.
I20260808 14:57:01.128949 26362 tablet_bootstrap.cc:492] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: Bootstrap starting.
I20260808 14:57:01.130170 26361 tablet_bootstrap.cc:654] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:01.130730 26362 tablet_bootstrap.cc:654] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:01.132541 26361 tablet_bootstrap.cc:492] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2: No bootstrap required, opened a new log
I20260808 14:57:01.132704 26361 ts_tablet_manager.cc:1397] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260808 14:57:01.133533 26365 tablet_bootstrap.cc:492] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea: Bootstrap starting.
I20260808 14:57:01.133440 26361 raft_consensus.cc:348] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.133684 26361 raft_consensus.cc:374] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:01.133766 26361 raft_consensus.cc:729] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a1103a37cf43daa606eac2a688bdd2, State: Initialized, Role: FOLLOWER
I20260808 14:57:01.134750 26361 consensus_queue.cc:260] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.135253 26365 tablet_bootstrap.cc:654] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:01.135241 26369 tablet_replica.cc:439] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } }
I20260808 14:57:01.135588 26369 tablet_replica.cc:442] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:57:01.136049 26361 ts_tablet_manager.cc:1428] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:57:01.137595 26365 tablet_bootstrap.cc:492] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea: No bootstrap required, opened a new log
I20260808 14:57:01.137787 26365 ts_tablet_manager.cc:1397] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 14:57:01.138495 26365 raft_consensus.cc:348] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.138783 26365 raft_consensus.cc:374] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:01.138855 26365 raft_consensus.cc:729] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb9f7814639c45fc81d1fc551ac6b5ea, State: Initialized, Role: FOLLOWER
I20260808 14:57:01.139091 26365 consensus_queue.cc:260] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.139670 26365 ts_tablet_manager.cc:1428] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 14:57:01.139511 26372 tablet_replica.cc:439] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } }
I20260808 14:57:01.139971 26372 tablet_replica.cc:442] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:57:01.141532 26362 tablet_bootstrap.cc:492] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: No bootstrap required, opened a new log
I20260808 14:57:01.141729 26362 ts_tablet_manager.cc:1397] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260808 14:57:01.142488 26362 raft_consensus.cc:348] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.142756 26362 raft_consensus.cc:374] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:01.142858 26362 raft_consensus.cc:729] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84a66f0cbb1d48419e68287df27a98e5, State: Initialized, Role: FOLLOWER
I20260808 14:57:01.143100 26362 consensus_queue.cc:260] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.143575 26392 tablet_replica.cc:439] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } }
I20260808 14:57:01.143741 26362 ts_tablet_manager.cc:1428] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 14:57:01.143867 26392 tablet_replica.cc:442] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 14:57:01.163533 26080 tablet.cc:2369] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:57:01.199115 26316 tablet.cc:2369] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:57:01.323709 26392 raft_consensus.cc:482] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:57:01.323943 26392 raft_consensus.cc:504] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.324684 26392 leader_election.cc:288] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453), bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111)
I20260808 14:57:01.325361 25791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5125686e62d84a8f99dfb50bf5b6e572" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a1103a37cf43daa606eac2a688bdd2" is_pre_election: true
I20260808 14:57:01.325460 26238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5125686e62d84a8f99dfb50bf5b6e572" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" is_pre_election: true
I20260808 14:57:01.325662 25791 raft_consensus.cc:2454] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 0.
I20260808 14:57:01.325732 26238 raft_consensus.cc:2454] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 0.
I20260808 14:57:01.326234 25898 leader_election.cc:302] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a1103a37cf43daa606eac2a688bdd2, 84a66f0cbb1d48419e68287df27a98e5; no voters:
I20260808 14:57:01.326596 26392 raft_consensus.cc:2781] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:57:01.326697 26392 raft_consensus.cc:482] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:57:01.326807 26392 raft_consensus.cc:3037] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:01.330067 26392 raft_consensus.cc:504] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.330687 26392 leader_election.cc:288] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 election: Requested vote from peers 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453), bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111)
I20260808 14:57:01.331292 26238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5125686e62d84a8f99dfb50bf5b6e572" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea"
I20260808 14:57:01.331501 26238 raft_consensus.cc:3037] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:01.331496 25791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5125686e62d84a8f99dfb50bf5b6e572" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a1103a37cf43daa606eac2a688bdd2"
I20260808 14:57:01.331739 25791 raft_consensus.cc:3037] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:01.334350 26238 raft_consensus.cc:2454] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 1.
I20260808 14:57:01.334923 25791 raft_consensus.cc:2454] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 1.
I20260808 14:57:01.335505 25895 leader_election.cc:302] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84a66f0cbb1d48419e68287df27a98e5, bb9f7814639c45fc81d1fc551ac6b5ea; no voters:
I20260808 14:57:01.335840 26392 raft_consensus.cc:2781] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:57:01.336014 26392 raft_consensus.cc:686] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 LEADER]: Becoming Leader. State: Replica: 84a66f0cbb1d48419e68287df27a98e5, State: Running, Role: LEADER
I20260808 14:57:01.336266 26392 consensus_queue.cc:237] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.341979 26378 tablet_replica.cc:439] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: TxnStatusTablet state changed. Reason: New leader 84a66f0cbb1d48419e68287df27a98e5. Latest consensus state: current_term: 1 leader_uuid: "84a66f0cbb1d48419e68287df27a98e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } }
I20260808 14:57:01.342288 26378 tablet_replica.cc:442] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:57:01.343362 26427 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:57:01.343686 26427 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:57:01.344102 25545 catalog_manager.cc:5495] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84a66f0cbb1d48419e68287df27a98e5 (127.12.73.130). New cstate: current_term: 1 leader_uuid: "84a66f0cbb1d48419e68287df27a98e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } health_report { overall_health: UNKNOWN } } }
I20260808 14:57:01.373027 26357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:01.367235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44030 (local address 127.12.73.130:36183)
0808 14:57:01.367453 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:01.367460 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:01.367487 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:57:01.367778 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:01.367785 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:01.367893 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:01.368004 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:57:01.368438 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.369493 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.371057 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.371527 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.371679 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.372172 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:57:01.372303 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:57:01.372414 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:01.372580 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 14:57:01.372660 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 14:57:01.373063 26421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:01.367094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:36183 (local address 127.0.0.1:44030)
0808 14:57:01.367368 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:01.367390 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:01.367546 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:01.368051 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:01.368056 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:01.368072 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:57:01.368283 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:01.368293 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.369637 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.369646 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:01.370895 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:01.370908 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.371702 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.371710 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:01.371904 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.371963 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:57:01.372420 (+ 457us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:57:01.372446 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 14:57:01.372554 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:57:01.372738 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 14:57:01.376679 25791 raft_consensus.cc:1261] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Refusing update from remote peer 84a66f0cbb1d48419e68287df27a98e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:57:01.376828 26238 raft_consensus.cc:1261] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Refusing update from remote peer 84a66f0cbb1d48419e68287df27a98e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:57:01.377393 26378 consensus_queue.cc:1035] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:57:01.377907 26392 consensus_queue.cc:1035] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:57:01.381631 26372 tablet_replica.cc:439] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea: TxnStatusTablet state changed. Reason: New leader 84a66f0cbb1d48419e68287df27a98e5. Latest consensus state: current_term: 1 leader_uuid: "84a66f0cbb1d48419e68287df27a98e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } }
I20260808 14:57:01.381935 26372 tablet_replica.cc:442] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:57:01.383237 26392 tablet_replica.cc:439] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "84a66f0cbb1d48419e68287df27a98e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } }
I20260808 14:57:01.383599 26392 tablet_replica.cc:442] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:57:01.385300 26386 mvcc.cc:205] Tried to move back new op lower bound from 7316279383552675840 to 7316279383395586048. Current Snapshot: MvccSnapshot[applied={T|T < 7316279383552675840}]
I20260808 14:57:01.386401 26372 tablet_replica.cc:439] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "84a66f0cbb1d48419e68287df27a98e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } }
I20260808 14:57:01.386693 26372 tablet_replica.cc:442] T 5125686e62d84a8f99dfb50bf5b6e572 P bb9f7814639c45fc81d1fc551ac6b5ea: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:57:01.395196 26369 tablet_replica.cc:439] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2: TxnStatusTablet state changed. Reason: New leader 84a66f0cbb1d48419e68287df27a98e5. Latest consensus state: current_term: 1 leader_uuid: "84a66f0cbb1d48419e68287df27a98e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } }
I20260808 14:57:01.395499 26369 tablet_replica.cc:442] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:57:01.397648 26378 tablet_replica.cc:439] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "84a66f0cbb1d48419e68287df27a98e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } }
I20260808 14:57:01.397917 26378 tablet_replica.cc:442] T 5125686e62d84a8f99dfb50bf5b6e572 P 84a66f0cbb1d48419e68287df27a98e5: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:57:01.400091 26369 tablet_replica.cc:439] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "84a66f0cbb1d48419e68287df27a98e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } } }
I20260808 14:57:01.400357 26369 tablet_replica.cc:442] T 5125686e62d84a8f99dfb50bf5b6e572 P 75a1103a37cf43daa606eac2a688bdd2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:57:01.409447 26357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:01.403287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:36791 (local address 127.12.73.130:36183)
0808 14:57:01.403501 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:01.403509 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:01.403769 (+ 260us) server_negotiation.cc:407] Connection header received
0808 14:57:01.404079 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:01.404084 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:01.404156 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:01.404262 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:57:01.404830 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.405708 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.407299 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.407781 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.407936 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.408455 (+ 519us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:57:01.408566 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:57:01.408673 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:01.408798 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 14:57:01.408944 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":58}
I20260808 14:57:01.409633 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:01.402866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:36183 (local address 127.12.73.130:36791)
0808 14:57:01.403669 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:01.403693 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:01.403883 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:01.404275 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:01.404279 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:01.404291 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:57:01.404660 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:01.404675 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.405837 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.405846 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:01.407141 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:01.407154 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.407984 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.407993 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:01.408183 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.408245 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:57:01.408672 (+ 427us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:57:01.408685 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 14:57:01.408773 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:57:01.408997 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"mutex_wait_us":24,"thread_start_us":466,"threads_started":1}
I20260808 14:57:01.419200 25789 raft_consensus.cc:1261] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Refusing update from remote peer 84a66f0cbb1d48419e68287df27a98e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:57:01.419243 26238 raft_consensus.cc:1261] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Refusing update from remote peer 84a66f0cbb1d48419e68287df27a98e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:57:01.419759 26371 consensus_queue.cc:1035] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:57:01.420121 26392 consensus_queue.cc:1035] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:57:01.490226 25545 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:57:01.490509 25545 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:57:01.494031 25545 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55: Sending DeleteTablet for 3 replicas of tablet 6039d35da436412386a23b0cbc60e7f1
I20260808 14:57:01.494978 25972 tablet_service.cc:1514] Processing DeleteTablet for tablet 6039d35da436412386a23b0cbc60e7f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:01 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:44012
I20260808 14:57:01.495237 26200 tablet_service.cc:1514] Processing DeleteTablet for tablet 6039d35da436412386a23b0cbc60e7f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:01 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:47498
I20260808 14:57:01.496032 25763 tablet_service.cc:1514] Processing DeleteTablet for tablet 6039d35da436412386a23b0cbc60e7f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:01 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:39388
I20260808 14:57:01.505707 26446 tablet_replica.cc:330] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5: stopping tablet replica
I20260808 14:57:01.505947 26446 raft_consensus.cc:2229] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:57:01.506358 26446 raft_consensus.cc:2258] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:01.510275 26446 ts_tablet_manager.cc:1905] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:01.514432 26450 tablet_replica.cc:330] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2: stopping tablet replica
I20260808 14:57:01.514662 26450 raft_consensus.cc:2229] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:57:01.514930 26450 raft_consensus.cc:2258] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:01.515537 26447 tablet_replica.cc:330] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea: stopping tablet replica
I20260808 14:57:01.516891 26447 raft_consensus.cc:2229] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:57:01.517211 26447 raft_consensus.cc:2258] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:01.518961 26447 ts_tablet_manager.cc:1905] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:01.520742 26450 ts_tablet_manager.cc:1905] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:01.521611 26446 ts_tablet_manager.cc:1918] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:57:01.521786 26446 log.cc:1196] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/6039d35da436412386a23b0cbc60e7f1
I20260808 14:57:01.522488 26446 ts_tablet_manager.cc:1939] T 6039d35da436412386a23b0cbc60e7f1 P 84a66f0cbb1d48419e68287df27a98e5: Deleting consensus metadata
I20260808 14:57:01.523878 25518 catalog_manager.cc:4841] TS 84a66f0cbb1d48419e68287df27a98e5 (127.12.73.130:36183): tablet 6039d35da436412386a23b0cbc60e7f1 (table test-table [id=5f7b0eb594094f069897bedc9297ac59]) successfully deleted
I20260808 14:57:01.527156 26447 ts_tablet_manager.cc:1918] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:57:01.527352 26447 log.cc:1196] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/6039d35da436412386a23b0cbc60e7f1
I20260808 14:57:01.527859 26447 ts_tablet_manager.cc:1939] T 6039d35da436412386a23b0cbc60e7f1 P bb9f7814639c45fc81d1fc551ac6b5ea: Deleting consensus metadata
I20260808 14:57:01.529161 25514 catalog_manager.cc:4841] TS bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111): tablet 6039d35da436412386a23b0cbc60e7f1 (table test-table [id=5f7b0eb594094f069897bedc9297ac59]) successfully deleted
I20260808 14:57:01.530632 26450 ts_tablet_manager.cc:1918] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:57:01.530836 26450 log.cc:1196] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/6039d35da436412386a23b0cbc60e7f1
I20260808 14:57:01.531344 26450 ts_tablet_manager.cc:1939] T 6039d35da436412386a23b0cbc60e7f1 P 75a1103a37cf43daa606eac2a688bdd2: Deleting consensus metadata
I20260808 14:57:01.532444 25518 catalog_manager.cc:4841] TS 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453): tablet 6039d35da436412386a23b0cbc60e7f1 (table test-table [id=5f7b0eb594094f069897bedc9297ac59]) successfully deleted
Aug 08 14:57:01 dist-test-slave-z8x9 krb5kdc[25470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:57:01 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:01 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:57:01.575436 25911 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:01.563508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50904 (local address 127.12.73.190:35697)
0808 14:57:01.563748 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:01.563754 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:01.564068 (+ 314us) server_negotiation.cc:407] Connection header received
0808 14:57:01.564225 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:01.564231 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:01.564323 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:01.564447 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:01.566002 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.567203 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.568486 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.569239 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.569357 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.575093 (+ 5736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50904: BlockingRecv error: recv got EOF from 127.0.0.1:50904 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 14:57:01 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM
I20260808 14:57:01.593941 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:01.578439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50906 (local address 127.12.73.190:35697)
0808 14:57:01.578623 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:01.578628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:01.578894 (+ 266us) server_negotiation.cc:407] Connection header received
0808 14:57:01.579025 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:01.579030 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:01.579107 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:01.579208 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:01.580319 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.581530 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.582753 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.583401 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.583528 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.587302 (+ 3774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:01.587309 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:01.587314 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:01.587355 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:01.590915 (+ 3560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:01.591772 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:01.591778 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:01.591782 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:01.591958 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:01.592341 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:01.592346 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:01.592350 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:01.592710 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:01.592968 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:01.593270 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 14:57:01.593515 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:57:01.598071 25545 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:57:01.598780 25545 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:57:01.605535 25763 tablet_service.cc:1467] Processing CreateTablet for tablet a9419f75bdbb4a2f9659251717b9f342 (DEFAULT_TABLE table=test-table [id=084674ebb379496faba4b6101e8b6d13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:01.606012 25763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9419f75bdbb4a2f9659251717b9f342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:01.605967 26200 tablet_service.cc:1467] Processing CreateTablet for tablet a9419f75bdbb4a2f9659251717b9f342 (DEFAULT_TABLE table=test-table [id=084674ebb379496faba4b6101e8b6d13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:01.606335 26200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9419f75bdbb4a2f9659251717b9f342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:01.610129 25972 tablet_service.cc:1467] Processing CreateTablet for tablet a9419f75bdbb4a2f9659251717b9f342 (DEFAULT_TABLE table=test-table [id=084674ebb379496faba4b6101e8b6d13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:01.610569 25972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9419f75bdbb4a2f9659251717b9f342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:01.612463 26365 tablet_bootstrap.cc:492] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea: Bootstrap starting.
I20260808 14:57:01.612650 26361 tablet_bootstrap.cc:492] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2: Bootstrap starting.
I20260808 14:57:01.614125 26365 tablet_bootstrap.cc:654] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:01.614238 26361 tablet_bootstrap.cc:654] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:01.619755 26362 tablet_bootstrap.cc:492] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5: Bootstrap starting.
I20260808 14:57:01.622243 26362 tablet_bootstrap.cc:654] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:01.624015 26361 tablet_bootstrap.cc:492] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2: No bootstrap required, opened a new log
I20260808 14:57:01.624207 26361 ts_tablet_manager.cc:1397] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260808 14:57:01.625021 26361 raft_consensus.cc:348] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.625362 26361 raft_consensus.cc:374] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:01.625473 26361 raft_consensus.cc:729] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a1103a37cf43daa606eac2a688bdd2, State: Initialized, Role: FOLLOWER
I20260808 14:57:01.625762 26361 consensus_queue.cc:260] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.626421 26361 ts_tablet_manager.cc:1428] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:57:01.628000 26365 tablet_bootstrap.cc:492] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea: No bootstrap required, opened a new log
I20260808 14:57:01.628178 26365 ts_tablet_manager.cc:1397] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.006s
I20260808 14:57:01.629004 26365 raft_consensus.cc:348] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.629351 26365 raft_consensus.cc:374] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:01.629462 26365 raft_consensus.cc:729] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb9f7814639c45fc81d1fc551ac6b5ea, State: Initialized, Role: FOLLOWER
I20260808 14:57:01.629824 26365 consensus_queue.cc:260] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.631484 26365 ts_tablet_manager.cc:1428] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:57:01.633643 26362 tablet_bootstrap.cc:492] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5: No bootstrap required, opened a new log
I20260808 14:57:01.633821 26362 ts_tablet_manager.cc:1397] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.003s
I20260808 14:57:01.634503 26362 raft_consensus.cc:348] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.634718 26362 raft_consensus.cc:374] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:01.635038 26362 raft_consensus.cc:729] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84a66f0cbb1d48419e68287df27a98e5, State: Initialized, Role: FOLLOWER
I20260808 14:57:01.635283 26362 consensus_queue.cc:260] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.636088 26362 ts_tablet_manager.cc:1428] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:57:01.749536 26372 raft_consensus.cc:482] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:57:01.749836 26372 raft_consensus.cc:504] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.751770 26372 leader_election.cc:288] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453), 84a66f0cbb1d48419e68287df27a98e5 (127.12.73.130:36183)
I20260808 14:57:01.760160 26472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:01.752122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44453 (local address 127.12.73.131:46793)
0808 14:57:01.752670 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:01.752692 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:01.752815 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:01.754355 (+ 1540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:01.754360 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:01.754392 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:57:01.754763 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:01.754775 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.756390 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.756395 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:01.757982 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:01.757995 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.759299 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.759307 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:01.759476 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.759515 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:57:01.759630 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 14:57:01.759784 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":297,"threads_started":1}
I20260808 14:57:01.760182 26473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:01.752239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:46793 (local address 127.12.73.129:44453)
0808 14:57:01.754009 (+ 1770us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:01.754016 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:01.754035 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:57:01.754111 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:01.754119 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:01.754206 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:01.754328 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:57:01.755012 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.756217 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.758152 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.759057 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.759272 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.759345 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:01.759678 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 14:57:01.759833 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1618,"thread_start_us":1455,"threads_started":1}
I20260808 14:57:01.761397 26357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:01.753252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:43103 (local address 127.12.73.130:36183)
0808 14:57:01.753521 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:01.753529 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:01.754396 (+ 867us) server_negotiation.cc:407] Connection header received
0808 14:57:01.754763 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:01.754769 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:01.754857 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:01.754944 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:57:01.755483 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.756316 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.758943 (+ 2627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.760158 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.760342 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.760420 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:01.760960 (+ 540us) server_negotiation.cc:299] Negotiation successful
0808 14:57:01.761090 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 14:57:01.761287 25789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9419f75bdbb4a2f9659251717b9f342" candidate_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a1103a37cf43daa606eac2a688bdd2" is_pre_election: true
I20260808 14:57:01.761456 26474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:01.752841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:36183 (local address 127.12.73.131:43103)
0808 14:57:01.754267 (+ 1426us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:01.754287 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:01.754550 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:01.754974 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:01.754978 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:01.755002 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:57:01.755325 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:01.755333 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.756502 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.756508 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:01.758726 (+ 2218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:01.758754 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.760588 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.760594 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:01.760794 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.760817 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:57:01.760928 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 14:57:01.761047 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1292,"spinlock_wait_cycles":12032,"thread_start_us":1096,"threads_started":1}
I20260808 14:57:01.761618 25789 raft_consensus.cc:2454] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb9f7814639c45fc81d1fc551ac6b5ea in term 0.
I20260808 14:57:01.762133 26116 leader_election.cc:302] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a1103a37cf43daa606eac2a688bdd2, bb9f7814639c45fc81d1fc551ac6b5ea; no voters:
I20260808 14:57:01.762583 26372 raft_consensus.cc:2781] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:57:01.762720 26372 raft_consensus.cc:482] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:57:01.762850 26372 raft_consensus.cc:3037] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:01.762616 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9419f75bdbb4a2f9659251717b9f342" candidate_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84a66f0cbb1d48419e68287df27a98e5" is_pre_election: true
I20260808 14:57:01.763161 26001 raft_consensus.cc:2454] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb9f7814639c45fc81d1fc551ac6b5ea in term 0.
I20260808 14:57:01.765534 26372 raft_consensus.cc:504] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.766142 26372 leader_election.cc:288] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [CANDIDATE]: Term 1 election: Requested vote from peers 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453), 84a66f0cbb1d48419e68287df27a98e5 (127.12.73.130:36183)
I20260808 14:57:01.766649 25789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9419f75bdbb4a2f9659251717b9f342" candidate_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a1103a37cf43daa606eac2a688bdd2"
I20260808 14:57:01.766780 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9419f75bdbb4a2f9659251717b9f342" candidate_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84a66f0cbb1d48419e68287df27a98e5"
I20260808 14:57:01.766916 25789 raft_consensus.cc:3037] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:01.767021 26001 raft_consensus.cc:3037] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:01.769562 26001 raft_consensus.cc:2454] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb9f7814639c45fc81d1fc551ac6b5ea in term 1.
I20260808 14:57:01.769976 25789 raft_consensus.cc:2454] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb9f7814639c45fc81d1fc551ac6b5ea in term 1.
I20260808 14:57:01.770346 26116 leader_election.cc:302] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84a66f0cbb1d48419e68287df27a98e5, bb9f7814639c45fc81d1fc551ac6b5ea; no voters:
I20260808 14:57:01.770664 26372 raft_consensus.cc:2781] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:57:01.771219 26372 raft_consensus.cc:686] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 LEADER]: Becoming Leader. State: Replica: bb9f7814639c45fc81d1fc551ac6b5ea, State: Running, Role: LEADER
I20260808 14:57:01.771626 26372 consensus_queue.cc:237] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.775408 25545 catalog_manager.cc:5495] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea reported cstate change: term changed from 0 to 1, leader changed from <none> to bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131). New cstate: current_term: 1 leader_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } health_report { overall_health: HEALTHY } } }
I20260808 14:57:01.794343 26481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:01.785051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47512 (local address 127.12.73.131:44111)
0808 14:57:01.788418 (+ 3367us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:01.788423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:01.788443 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:57:01.788528 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:01.788531 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:01.788606 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:01.788892 (+ 286us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:57:01.789368 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.790172 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.791657 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:01.792252 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:01.792387 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:01.792870 (+ 483us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:57:01.793557 (+ 687us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:57:01.793723 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:01.793856 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 14:57:01.793946 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3259,"thread_start_us":3123,"threads_started":1}
I20260808 14:57:01.798610 25789 raft_consensus.cc:1261] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Refusing update from remote peer bb9f7814639c45fc81d1fc551ac6b5ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:57:01.798667 26001 raft_consensus.cc:1261] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Refusing update from remote peer bb9f7814639c45fc81d1fc551ac6b5ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:57:01.799513 26475 consensus_queue.cc:1035] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:57:01.800009 26372 consensus_queue.cc:1035] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:57:01.826790 25545 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:57:01.827085 25545 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:57:01.830659 25545 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55: Sending DeleteTablet for 3 replicas of tablet a9419f75bdbb4a2f9659251717b9f342
I20260808 14:57:01.831508 25763 tablet_service.cc:1514] Processing DeleteTablet for tablet a9419f75bdbb4a2f9659251717b9f342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:01 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:39388
I20260808 14:57:01.831826 26450 tablet_replica.cc:330] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2: stopping tablet replica
I20260808 14:57:01.832022 26450 raft_consensus.cc:2229] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:57:01.832238 26450 raft_consensus.cc:2258] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:01.832965 26200 tablet_service.cc:1514] Processing DeleteTablet for tablet a9419f75bdbb4a2f9659251717b9f342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:01 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:47498
I20260808 14:57:01.833254 26447 tablet_replica.cc:330] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea: stopping tablet replica
I20260808 14:57:01.833376 25972 tablet_service.cc:1514] Processing DeleteTablet for tablet a9419f75bdbb4a2f9659251717b9f342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:01 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:44012
I20260808 14:57:01.833467 26447 raft_consensus.cc:2229] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:57:01.833662 26446 tablet_replica.cc:330] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5: stopping tablet replica
I20260808 14:57:01.833854 26446 raft_consensus.cc:2229] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:57:01.833974 26447 raft_consensus.cc:2258] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:01.834096 26446 raft_consensus.cc:2258] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:01.835199 26447 ts_tablet_manager.cc:1905] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:01.835238 26446 ts_tablet_manager.cc:1905] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:01.835074 25545 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:57:01.835700 25545 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:57:01.837534 26450 ts_tablet_manager.cc:1905] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:01.841856 26446 ts_tablet_manager.cc:1918] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:57:01.841877 26447 ts_tablet_manager.cc:1918] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:57:01.842028 26446 log.cc:1196] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/a9419f75bdbb4a2f9659251717b9f342
I20260808 14:57:01.842239 26447 log.cc:1196] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/a9419f75bdbb4a2f9659251717b9f342
I20260808 14:57:01.842487 26446 ts_tablet_manager.cc:1939] T a9419f75bdbb4a2f9659251717b9f342 P 84a66f0cbb1d48419e68287df27a98e5: Deleting consensus metadata
I20260808 14:57:01.842852 26447 ts_tablet_manager.cc:1939] T a9419f75bdbb4a2f9659251717b9f342 P bb9f7814639c45fc81d1fc551ac6b5ea: Deleting consensus metadata
I20260808 14:57:01.842796 25763 tablet_service.cc:1467] Processing CreateTablet for tablet 0a765fcef0364547a03a3ff0ceac7fab (DEFAULT_TABLE table=test-table [id=a729ccbfa5bb478fb557195d7c1a9d01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:01.843190 25763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a765fcef0364547a03a3ff0ceac7fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:01.849489 25514 catalog_manager.cc:4841] TS bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111): tablet a9419f75bdbb4a2f9659251717b9f342 (table test-table [id=084674ebb379496faba4b6101e8b6d13]) successfully deleted
I20260808 14:57:01.849577 25518 catalog_manager.cc:4841] TS 84a66f0cbb1d48419e68287df27a98e5 (127.12.73.130:36183): tablet a9419f75bdbb4a2f9659251717b9f342 (table test-table [id=084674ebb379496faba4b6101e8b6d13]) successfully deleted
I20260808 14:57:01.850346 26200 tablet_service.cc:1467] Processing CreateTablet for tablet 0a765fcef0364547a03a3ff0ceac7fab (DEFAULT_TABLE table=test-table [id=a729ccbfa5bb478fb557195d7c1a9d01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:01.850363 25972 tablet_service.cc:1467] Processing CreateTablet for tablet 0a765fcef0364547a03a3ff0ceac7fab (DEFAULT_TABLE table=test-table [id=a729ccbfa5bb478fb557195d7c1a9d01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:01.850816 26200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a765fcef0364547a03a3ff0ceac7fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:01.850833 25972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a765fcef0364547a03a3ff0ceac7fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:01.858481 26365 tablet_bootstrap.cc:492] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea: Bootstrap starting.
I20260808 14:57:01.859543 26361 tablet_bootstrap.cc:492] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2: Bootstrap starting.
I20260808 14:57:01.860255 26365 tablet_bootstrap.cc:654] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:01.861214 26361 tablet_bootstrap.cc:654] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:01.865504 26362 tablet_bootstrap.cc:492] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5: Bootstrap starting.
I20260808 14:57:01.867260 26362 tablet_bootstrap.cc:654] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:01.868981 26365 tablet_bootstrap.cc:492] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea: No bootstrap required, opened a new log
I20260808 14:57:01.869275 26365 ts_tablet_manager.cc:1397] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260808 14:57:01.870252 26365 raft_consensus.cc:348] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.871428 26365 raft_consensus.cc:374] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:01.871717 26365 raft_consensus.cc:729] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb9f7814639c45fc81d1fc551ac6b5ea, State: Initialized, Role: FOLLOWER
I20260808 14:57:01.872236 26365 consensus_queue.cc:260] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.874114 26361 tablet_bootstrap.cc:492] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2: No bootstrap required, opened a new log
I20260808 14:57:01.874310 26361 ts_tablet_manager.cc:1397] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.007s
I20260808 14:57:01.874719 26365 ts_tablet_manager.cc:1428] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260808 14:57:01.876334 26450 ts_tablet_manager.cc:1918] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:57:01.876685 26450 log.cc:1196] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/a9419f75bdbb4a2f9659251717b9f342
I20260808 14:57:01.878681 26361 raft_consensus.cc:348] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.878937 26361 raft_consensus.cc:374] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:01.879004 26361 raft_consensus.cc:729] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a1103a37cf43daa606eac2a688bdd2, State: Initialized, Role: FOLLOWER
I20260808 14:57:01.879268 26361 consensus_queue.cc:260] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.879797 26361 ts_tablet_manager.cc:1428] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2: Time spent starting tablet: real 0.005s user 0.000s sys 0.000s
I20260808 14:57:01.880721 26450 ts_tablet_manager.cc:1939] T a9419f75bdbb4a2f9659251717b9f342 P 75a1103a37cf43daa606eac2a688bdd2: Deleting consensus metadata
I20260808 14:57:01.882699 25518 catalog_manager.cc:4841] TS 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453): tablet a9419f75bdbb4a2f9659251717b9f342 (table test-table [id=084674ebb379496faba4b6101e8b6d13]) successfully deleted
I20260808 14:57:01.886854 26362 tablet_bootstrap.cc:492] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5: No bootstrap required, opened a new log
I20260808 14:57:01.887072 26362 ts_tablet_manager.cc:1397] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.006s
I20260808 14:57:01.888025 26362 raft_consensus.cc:348] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.888327 26362 raft_consensus.cc:374] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:01.888414 26362 raft_consensus.cc:729] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84a66f0cbb1d48419e68287df27a98e5, State: Initialized, Role: FOLLOWER
I20260808 14:57:01.888695 26362 consensus_queue.cc:260] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:01.889968 26362 ts_tablet_manager.cc:1428] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 14:57:02.178346 26445 raft_consensus.cc:482] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:57:02.178535 26445 raft_consensus.cc:504] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:02.179266 26445 leader_election.cc:288] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453), bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111)
I20260808 14:57:02.179863 26231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a765fcef0364547a03a3ff0ceac7fab" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" is_pre_election: true
I20260808 14:57:02.179914 25791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a765fcef0364547a03a3ff0ceac7fab" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a1103a37cf43daa606eac2a688bdd2" is_pre_election: true
I20260808 14:57:02.180166 26231 raft_consensus.cc:2454] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 0.
I20260808 14:57:02.180224 25791 raft_consensus.cc:2454] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 0.
I20260808 14:57:02.180723 25895 leader_election.cc:302] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84a66f0cbb1d48419e68287df27a98e5, bb9f7814639c45fc81d1fc551ac6b5ea; no voters:
I20260808 14:57:02.181030 26445 raft_consensus.cc:2781] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:57:02.181201 26445 raft_consensus.cc:482] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:57:02.181301 26445 raft_consensus.cc:3037] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:02.183254 26445 raft_consensus.cc:504] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:02.183977 26445 leader_election.cc:288] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 election: Requested vote from peers 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453), bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111)
I20260808 14:57:02.184388 25791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a765fcef0364547a03a3ff0ceac7fab" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a1103a37cf43daa606eac2a688bdd2"
I20260808 14:57:02.184641 25791 raft_consensus.cc:3037] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:02.184746 26231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a765fcef0364547a03a3ff0ceac7fab" candidate_uuid: "84a66f0cbb1d48419e68287df27a98e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea"
I20260808 14:57:02.184981 26231 raft_consensus.cc:3037] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:02.186820 25791 raft_consensus.cc:2454] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 1.
I20260808 14:57:02.187253 25898 leader_election.cc:302] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a1103a37cf43daa606eac2a688bdd2, 84a66f0cbb1d48419e68287df27a98e5; no voters:
I20260808 14:57:02.187551 26445 raft_consensus.cc:2781] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:57:02.188004 26445 raft_consensus.cc:686] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 1 LEADER]: Becoming Leader. State: Replica: 84a66f0cbb1d48419e68287df27a98e5, State: Running, Role: LEADER
I20260808 14:57:02.188321 26445 consensus_queue.cc:237] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } }
I20260808 14:57:02.189399 26231 raft_consensus.cc:2454] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84a66f0cbb1d48419e68287df27a98e5 in term 1.
I20260808 14:57:02.191298 25545 catalog_manager.cc:5495] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84a66f0cbb1d48419e68287df27a98e5 (127.12.73.130). New cstate: current_term: 1 leader_uuid: "84a66f0cbb1d48419e68287df27a98e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84a66f0cbb1d48419e68287df27a98e5" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 36183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 } health_report { overall_health: UNKNOWN } } }
I20260808 14:57:02.249415 26357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:02.244354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44046 (local address 127.12.73.130:36183)
0808 14:57:02.244558 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:02.244566 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:02.244791 (+ 225us) server_negotiation.cc:407] Connection header received
0808 14:57:02.245016 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:02.245021 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:02.245104 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:02.245239 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:57:02.245650 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:02.246363 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:02.247679 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:02.248096 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:02.248236 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:02.248676 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:57:02.248785 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:57:02.248892 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:02.249016 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 14:57:02.249095 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:57:02.258677 25791 raft_consensus.cc:1261] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Refusing update from remote peer 84a66f0cbb1d48419e68287df27a98e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:57:02.258687 26238 raft_consensus.cc:1261] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Refusing update from remote peer 84a66f0cbb1d48419e68287df27a98e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:57:02.259270 26445 consensus_queue.cc:1035] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb9f7814639c45fc81d1fc551ac6b5ea" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:57:02.259577 26490 consensus_queue.cc:1035] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a1103a37cf43daa606eac2a688bdd2" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:57:02.306720 25547 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:57:02.306946 25547 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:57:02.309500 25547 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a6f88d20c1e943d9b9523ec88131bf55: Sending DeleteTablet for 3 replicas of tablet 0a765fcef0364547a03a3ff0ceac7fab
I20260808 14:57:02.310233 25763 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a765fcef0364547a03a3ff0ceac7fab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:02 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:39388
I20260808 14:57:02.310416 26200 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a765fcef0364547a03a3ff0ceac7fab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:02 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:47498
I20260808 14:57:02.310432 25971 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a765fcef0364547a03a3ff0ceac7fab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:02 UTC) from {username='oryx', principal='oryx/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:44012
I20260808 14:57:02.310755 26447 tablet_replica.cc:330] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea: stopping tablet replica
I20260808 14:57:02.310741 26450 tablet_replica.cc:330] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2: stopping tablet replica
I20260808 14:57:02.310947 26447 raft_consensus.cc:2229] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:57:02.310947 26450 raft_consensus.cc:2229] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:57:02.311134 26447 raft_consensus.cc:2258] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:02.311159 26450 raft_consensus.cc:2258] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:02.311275 26446 tablet_replica.cc:330] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5: stopping tablet replica
I20260808 14:57:02.311468 26446 raft_consensus.cc:2229] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:57:02.311807 26446 raft_consensus.cc:2258] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:02.312222 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 25661
I20260808 14:57:02.312265 26447 ts_tablet_manager.cc:1905] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:02.312307 26450 ts_tablet_manager.cc:1905] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:02.313066 26446 ts_tablet_manager.cc:1905] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:02.319303 26450 ts_tablet_manager.cc:1918] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:57:02.319445 26450 log.cc:1196] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/0a765fcef0364547a03a3ff0ceac7fab
I20260808 14:57:02.319911 26450 ts_tablet_manager.cc:1939] T 0a765fcef0364547a03a3ff0ceac7fab P 75a1103a37cf43daa606eac2a688bdd2: Deleting consensus metadata
I20260808 14:57:02.320252 26447 ts_tablet_manager.cc:1918] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:57:02.320420 26447 log.cc:1196] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/0a765fcef0364547a03a3ff0ceac7fab
I20260808 14:57:02.320731 26446 ts_tablet_manager.cc:1918] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:57:02.320910 26447 ts_tablet_manager.cc:1939] T 0a765fcef0364547a03a3ff0ceac7fab P bb9f7814639c45fc81d1fc551ac6b5ea: Deleting consensus metadata
I20260808 14:57:02.320935 26446 log.cc:1196] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/0a765fcef0364547a03a3ff0ceac7fab
I20260808 14:57:02.321110 25518 catalog_manager.cc:4841] TS 75a1103a37cf43daa606eac2a688bdd2 (127.12.73.129:44453): tablet 0a765fcef0364547a03a3ff0ceac7fab (table test-table [id=a729ccbfa5bb478fb557195d7c1a9d01]) successfully deleted
I20260808 14:57:02.321691 26446 ts_tablet_manager.cc:1939] T 0a765fcef0364547a03a3ff0ceac7fab P 84a66f0cbb1d48419e68287df27a98e5: Deleting consensus metadata
I20260808 14:57:02.322224 25514 catalog_manager.cc:4841] TS bb9f7814639c45fc81d1fc551ac6b5ea (127.12.73.131:44111): tablet 0a765fcef0364547a03a3ff0ceac7fab (table test-table [id=a729ccbfa5bb478fb557195d7c1a9d01]) successfully deleted
I20260808 14:57:02.322968 25518 catalog_manager.cc:4841] TS 84a66f0cbb1d48419e68287df27a98e5 (127.12.73.130:36183): tablet 0a765fcef0364547a03a3ff0ceac7fab (table test-table [id=a729ccbfa5bb478fb557195d7c1a9d01]) successfully deleted
Aug 08 14:57:02 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.73.129@KRBTEST.COM
I20260808 14:57:02.342150 26502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:02.313786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39400 (local address 127.12.73.129:44453)
0808 14:57:02.327961 (+ 14175us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:02.327965 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:02.327982 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:57:02.328029 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:02.328032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:02.328091 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:02.328230 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:02.329579 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:02.330299 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:02.331551 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:02.331989 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:02.332124 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:02.336171 (+ 4047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:02.336186 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:02.336202 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:02.336231 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:02.339299 (+ 3068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:02.340005 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:02.340012 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:02.340015 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:02.340142 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:02.340544 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:02.340554 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:02.340556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:02.340936 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:02.341273 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:02.341567 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 14:57:02.341806 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14070,"thread_start_us":14567,"threads_started":1}
I20260808 14:57:02.342919 25853 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:02.442004 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 25661
I20260808 14:57:02.478850 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 25866
Aug 08 14:57:02 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.73.130@KRBTEST.COM
I20260808 14:57:02.496502 26357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:02.479714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44322 (local address 127.12.73.130:36183)
0808 14:57:02.479901 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:02.479907 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:02.479935 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:57:02.480132 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:02.480139 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:02.480220 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:02.480334 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:02.481727 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:02.482810 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:02.484126 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:02.484749 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:02.484888 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:02.489627 (+ 4739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:02.489645 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:02.489667 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:02.489723 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:02.493819 (+ 4096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:02.494452 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:02.494463 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:02.494467 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:02.494665 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:02.495024 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:02.495028 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:02.495032 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:02.495465 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:02.495796 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:02.495935 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 14:57:02.496146 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:57:02.497355 26073 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:02.653760 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 25866
I20260808 14:57:02.694468 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 26088
Aug 08 14:57:02 dist-test-slave-z8x9 krb5kdc[25470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.73.131@KRBTEST.COM
I20260808 14:57:02.710335 26506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:02.695268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36500 (local address 127.12.73.131:44111)
0808 14:57:02.695786 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:02.695791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:02.695806 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:57:02.695861 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:02.695865 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:02.695925 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:02.696053 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:02.697378 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:02.698221 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:02.699539 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:02.699936 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:02.700079 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:02.704543 (+ 4464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:02.704559 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:02.704576 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:02.704609 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:02.707460 (+ 2851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:02.708147 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:02.708154 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:02.708156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:02.708296 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:02.708697 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:02.708702 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:02.708705 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:02.709076 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:02.709418 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:02.709750 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 14:57:02.709985 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":254,"threads_started":1}
I20260808 14:57:02.711020 26309 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:02.838714 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 26088
I20260808 14:57:02.873688 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 25488
I20260808 14:57:02.874936 25609 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:02.993985 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 25488
2026-08-08T14:57:03Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7376 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:57:03 dist-test-slave-z8x9 krb5kdc[26513](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:57:03 dist-test-slave-z8x9 krb5kdc[26513](info): set up 2 sockets
Aug 08 14:57:03 dist-test-slave-z8x9 krb5kdc[26513](info): commencing operation
krb5kdc: starting...
W20260808 14:57:04.351336 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.001s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:57:04 dist-test-slave-z8x9 krb5kdc[26513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:57:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:57:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:57:04.632917 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:35661
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:42779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:35661
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:57:04.982565 26535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:04.982858 26535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:04.983028 26535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:04.990329 26535 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:57:04.990443 26535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:04.990520 26535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:04.990607 26535 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:57:04.990690 26535 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:57:05.000937 26535 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:42779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:35661
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:35661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:05.002388 26535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:05.003726 26535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:05.016004 26541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:05.016034 26546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:05.016119 26542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:05.018985 26535 server_base.cc:1034] running on GCE node
I20260808 14:57:05.019941 26535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:05.021477 26535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:05.022718 26535 hybrid_clock.cc:648] HybridClock initialized: now 1786201025022682 us; error 55 us; skew 500 ppm
I20260808 14:57:05.023075 26535 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T14:57:05Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2095 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:57:05 dist-test-slave-z8x9 krb5kdc[26556](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:57:05 dist-test-slave-z8x9 krb5kdc[26556](info): set up 2 sockets
Aug 08 14:57:05 dist-test-slave-z8x9 krb5kdc[26556](info): commencing operation
krb5kdc: starting...
W20260808 14:57:06.452288 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.001s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:57:06 dist-test-slave-z8x9 krb5kdc[26556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:57:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:57:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:57:06.722884 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33113
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:40459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:33113
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:57:07.052255 26579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:07.052628 26579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:07.052809 26579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:07.060267 26579 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:57:07.060431 26579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:07.060545 26579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:07.060652 26579 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:57:07.060740 26579 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:57:07.070875 26579 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:33113
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:07.072288 26579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:07.073648 26579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:07.085783 26585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:07.085842 26587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:07.085810 26590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:07.086799 26579 server_base.cc:1034] running on GCE node
I20260808 14:57:07.087556 26579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:07.088966 26579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:07.090179 26579 hybrid_clock.cc:648] HybridClock initialized: now 1786201027090122 us; error 49 us; skew 500 ppm
I20260808 14:57:07.090494 26579 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:57:07 dist-test-slave-z8x9 krb5kdc[26556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201027, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:57:07.130892 26579 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:57:07.132673 26579 webserver.cc:460] Webserver started at http://127.12.73.190:44927/ using document root <none> and password file <none>
I20260808 14:57:07.133509 26579 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:07.133661 26579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:07.133993 26579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:07.136996 26579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "f4299e91940a4643a342d3bf5b941246"
format_stamp: "Formatted at 2026-08-08 14:57:07 on dist-test-slave-z8x9"
server_key: "a9f64f4ddd81e1ef8a6415fdb647a638"
server_key_iv: "b1b9f246116cf8cee194b7a688b3e2c9"
server_key_version: "encryptionkey@0"
I20260808 14:57:07.137869 26579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "f4299e91940a4643a342d3bf5b941246"
format_stamp: "Formatted at 2026-08-08 14:57:07 on dist-test-slave-z8x9"
server_key: "a9f64f4ddd81e1ef8a6415fdb647a638"
server_key_iv: "b1b9f246116cf8cee194b7a688b3e2c9"
server_key_version: "encryptionkey@0"
I20260808 14:57:07.143121 26579 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:57:07.146447 26603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:07.147751 26579 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:57:07.147945 26579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "f4299e91940a4643a342d3bf5b941246"
format_stamp: "Formatted at 2026-08-08 14:57:07 on dist-test-slave-z8x9"
server_key: "a9f64f4ddd81e1ef8a6415fdb647a638"
server_key_iv: "b1b9f246116cf8cee194b7a688b3e2c9"
server_key_version: "encryptionkey@0"
I20260808 14:57:07.148144 26579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:07.168277 26579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:07.172788 26579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:07.173094 26579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:07.191999 26579 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:33113
I20260808 14:57:07.192022 26678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:33113 every 8 connection(s)
I20260808 14:57:07.193444 26579 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:57:07.197052 26679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:07.198582 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 26579
I20260808 14:57:07.198814 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:57:07.199606 12582 external_mini_cluster.cc:1428] Setting key 83dc6567f7abcbc5a04e3fd79c6d8c12
I20260808 14:57:07.211351 26679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246: Bootstrap starting.
Aug 08 14:57:07 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:57:07.214356 26679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:07.215451 26679 log.cc:824] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246: Log is configured to *not* fsync() on all Append() calls
I20260808 14:57:07.219020 26679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246: No bootstrap required, opened a new log
I20260808 14:57:07.224408 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:07.201637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58518 (local address 127.12.73.190:33113)
0808 14:57:07.202483 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:07.202503 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:07.202555 (+ 52us) server_negotiation.cc:407] Connection header received
0808 14:57:07.204233 (+ 1678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:07.204261 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:07.204779 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:07.205209 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:07.206702 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:07.208780 (+ 2078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:07.210106 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:07.211127 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:07.211310 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:07.215402 (+ 4092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:07.215416 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:07.215440 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:07.215496 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:07.219600 (+ 4104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:07.220565 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:07.220574 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:07.220585 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:07.220835 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:07.221480 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:07.221485 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:07.221489 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:07.222086 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:07.222437 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:07.222926 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 14:57:07.223370 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":328,"threads_started":1}
I20260808 14:57:07.227732 26679 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4299e91940a4643a342d3bf5b941246" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33113 } }
I20260808 14:57:07.228089 26679 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:07.228209 26679 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4299e91940a4643a342d3bf5b941246, State: Initialized, Role: FOLLOWER
I20260808 14:57:07.228749 26679 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4299e91940a4643a342d3bf5b941246" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33113 } }
I20260808 14:57:07.228991 26679 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:57:07.229140 26679 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:57:07.229357 26679 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:07.231575 26679 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4299e91940a4643a342d3bf5b941246" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33113 } }
I20260808 14:57:07.232168 26679 leader_election.cc:302] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4299e91940a4643a342d3bf5b941246; no voters:
I20260808 14:57:07.232849 26679 leader_election.cc:288] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:57:07.232975 26689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:57:07.233837 26689 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 1 LEADER]: Becoming Leader. State: Replica: f4299e91940a4643a342d3bf5b941246, State: Running, Role: LEADER
I20260808 14:57:07.234362 26689 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4299e91940a4643a342d3bf5b941246" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33113 } }
I20260808 14:57:07.235001 26679 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:57:07.237090 26695 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4299e91940a4643a342d3bf5b941246. Latest consensus state: current_term: 1 leader_uuid: "f4299e91940a4643a342d3bf5b941246" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4299e91940a4643a342d3bf5b941246" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33113 } } }
I20260808 14:57:07.237557 26695 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [sys.catalog]: This master's current role is: LEADER
I20260808 14:57:07.237378 26693 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4299e91940a4643a342d3bf5b941246" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4299e91940a4643a342d3bf5b941246" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33113 } } }
I20260808 14:57:07.237666 26693 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [sys.catalog]: This master's current role is: LEADER
I20260808 14:57:07.240464 26704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:57:07.245630 26704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:57:07.254503 26704 catalog_manager.cc:1347] Generated new cluster ID: e9a28535806d452ea4692a15e7cc0761
I20260808 14:57:07.254616 26704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:57:07.297663 26704 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:57:07.299033 26704 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:57:07.310119 26704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246: Generated new TSK 0
I20260808 14:57:07.311023 26704 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:57:07.386953 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33113
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:40459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:57:07.731144 26729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:07.731433 26729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:07.731529 26729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:07.739193 26729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:07.739308 26729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:07.739423 26729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:57:07.749569 26729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:07.750844 26729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:07.752588 26729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:07.766335 26738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:07.766373 26739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:07.766286 26741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:07.767391 26729 server_base.cc:1034] running on GCE node
I20260808 14:57:07.768041 26729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:07.768924 26729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:07.770187 26729 hybrid_clock.cc:648] HybridClock initialized: now 1786201027770104 us; error 67 us; skew 500 ppm
I20260808 14:57:07.770499 26729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:57:07 dist-test-slave-z8x9 krb5kdc[26556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201027, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:57:07.773877 26729 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:57:07.775383 26729 webserver.cc:460] Webserver started at http://127.12.73.129:41107/ using document root <none> and password file <none>
I20260808 14:57:07.776057 26729 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:07.776197 26729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:07.776520 26729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:07.779512 26729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "ba51454b97e4454ab3b014b394359768"
format_stamp: "Formatted at 2026-08-08 14:57:07 on dist-test-slave-z8x9"
server_key: "3cfc54be9ee1b0ff61f13af2c5d93d9e"
server_key_iv: "0433e33ee30a23c8ba1e3bc663085c34"
server_key_version: "encryptionkey@0"
I20260808 14:57:07.780299 26729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "ba51454b97e4454ab3b014b394359768"
format_stamp: "Formatted at 2026-08-08 14:57:07 on dist-test-slave-z8x9"
server_key: "3cfc54be9ee1b0ff61f13af2c5d93d9e"
server_key_iv: "0433e33ee30a23c8ba1e3bc663085c34"
server_key_version: "encryptionkey@0"
I20260808 14:57:07.785468 26729 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 14:57:07.788858 26757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:07.790251 26729 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:57:07.790455 26729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "ba51454b97e4454ab3b014b394359768"
format_stamp: "Formatted at 2026-08-08 14:57:07 on dist-test-slave-z8x9"
server_key: "3cfc54be9ee1b0ff61f13af2c5d93d9e"
server_key_iv: "0433e33ee30a23c8ba1e3bc663085c34"
server_key_version: "encryptionkey@0"
I20260808 14:57:07.790696 26729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:07.825793 26729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:07.830466 26729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:07.830797 26729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:07.831792 26729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:07.833217 26729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:07.833331 26729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:07.833490 26729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:07.833565 26729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:07.868083 26729 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:42175
I20260808 14:57:07.868153 26941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:42175 every 8 connection(s)
I20260808 14:57:07.869486 26729 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:57:07.875816 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 26729
I20260808 14:57:07.876049 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:57:07.876725 12582 external_mini_cluster.cc:1428] Setting key 16d67e94b4cb9ad54bdb10d8eff317b4
Aug 08 14:57:07 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201027, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:57:07.889731 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:07.872141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:53981 (local address 127.12.73.190:33113)
0808 14:57:07.872618 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:07.872622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:07.873500 (+ 878us) server_negotiation.cc:407] Connection header received
0808 14:57:07.875310 (+ 1810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:07.875316 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:07.875417 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:07.875540 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:07.877153 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:07.878072 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:07.879769 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:07.880172 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:07.880314 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:07.884051 (+ 3737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:07.884056 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:07.884059 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:07.884090 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:07.886686 (+ 2596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:07.887413 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:07.887419 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:07.887423 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:07.887543 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:07.887973 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:07.887978 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:07.887982 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:07.888247 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:07.888416 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:07.889095 (+ 679us) server_negotiation.cc:299] Negotiation successful
0808 14:57:07.889361 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":270,"threads_started":1}
I20260808 14:57:07.890669 26948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:07.872597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:53981)
0808 14:57:07.873339 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:07.873378 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:07.875047 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:07.875770 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:07.875778 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:07.876380 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:07.876970 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:07.876990 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:07.878241 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:07.878251 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:07.879621 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:07.879634 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:07.880410 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:07.880419 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:07.880661 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:07.881448 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:07.881474 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:07.883826 (+ 2352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:07.886830 (+ 3004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:07.886851 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:07.886867 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:07.887276 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:07.887658 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:07.887663 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:07.887666 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:07.887855 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:07.888389 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:07.888397 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:07.888730 (+ 333us) client_negotiation.cc:769] Sending connection context
0808 14:57:07.889009 (+ 279us) client_negotiation.cc:240] Negotiation successful
0808 14:57:07.889546 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":277,"threads_started":1}
I20260808 14:57:07.892387 26943 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33113
I20260808 14:57:07.892691 26943 heartbeater.cc:464] Registering TS with master...
I20260808 14:57:07.893481 26943 heartbeater.cc:511] Master 127.12.73.190:33113 requested a full tablet report, sending...
I20260808 14:57:07.895898 26635 ts_manager.cc:194] Registered new tserver with Master: ba51454b97e4454ab3b014b394359768 (127.12.73.129:42175)
I20260808 14:57:07.898135 26635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:53981
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:57:07.940434 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33113
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:40459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:57:08.280195 26951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:08.280484 26951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:08.280583 26951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:08.287969 26951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:08.288084 26951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:08.288264 26951 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:57:08.298550 26951 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:08.299858 26951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:08.301204 26951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:08.315035 26958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:08.314986 26959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:08.315212 26962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:08.315728 26951 server_base.cc:1034] running on GCE node
I20260808 14:57:08.316346 26951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:08.317430 26951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:08.318650 26951 hybrid_clock.cc:648] HybridClock initialized: now 1786201028318615 us; error 30 us; skew 500 ppm
I20260808 14:57:08.318981 26951 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:57:08 dist-test-slave-z8x9 krb5kdc[26556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:57:08.322348 26951 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:57:08.323809 26951 webserver.cc:460] Webserver started at http://127.12.73.130:44023/ using document root <none> and password file <none>
I20260808 14:57:08.324513 26951 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:08.324667 26951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:08.324996 26951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:08.328151 26951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "39ce506080fe43249fef17cf53241e4d"
format_stamp: "Formatted at 2026-08-08 14:57:08 on dist-test-slave-z8x9"
server_key: "a0a755d097bf7d4b8e16c9b8a799200f"
server_key_iv: "93bae17bf8847aa704f024a644b768f3"
server_key_version: "encryptionkey@0"
I20260808 14:57:08.328979 26951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "39ce506080fe43249fef17cf53241e4d"
format_stamp: "Formatted at 2026-08-08 14:57:08 on dist-test-slave-z8x9"
server_key: "a0a755d097bf7d4b8e16c9b8a799200f"
server_key_iv: "93bae17bf8847aa704f024a644b768f3"
server_key_version: "encryptionkey@0"
I20260808 14:57:08.334414 26951 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 14:57:08.338117 26977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:08.339478 26951 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:57:08.339680 26951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "39ce506080fe43249fef17cf53241e4d"
format_stamp: "Formatted at 2026-08-08 14:57:08 on dist-test-slave-z8x9"
server_key: "a0a755d097bf7d4b8e16c9b8a799200f"
server_key_iv: "93bae17bf8847aa704f024a644b768f3"
server_key_version: "encryptionkey@0"
I20260808 14:57:08.339912 26951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:08.353034 26951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:08.357548 26951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:08.357848 26951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:08.358736 26951 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:08.359993 26951 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:08.360080 26951 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:08.360165 26951 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:08.360225 26951 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:08.394651 26951 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:41397
I20260808 14:57:08.394759 27151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:41397 every 8 connection(s)
I20260808 14:57:08.396006 26951 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:57:08.398597 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 26951
I20260808 14:57:08.398793 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:57:08.399242 12582 external_mini_cluster.cc:1428] Setting key 8a8d7ffabd955761a43ce3928db30a25
Aug 08 14:57:08 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:57:08.417017 27155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:08.398598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:36691 (local address 127.12.73.190:33113)
0808 14:57:08.401379 (+ 2781us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:08.401385 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:08.401407 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:57:08.402465 (+ 1058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:08.402471 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:08.402555 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:08.402670 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:08.404098 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:08.404802 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:08.406416 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:08.406820 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:08.406961 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:08.410459 (+ 3498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:08.410464 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:08.410467 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:08.410496 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:08.413774 (+ 3278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:08.414711 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:08.414715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:08.414717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:08.414848 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:08.415347 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:08.415350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:08.415352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:08.415605 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:08.415724 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:08.416572 (+ 848us) server_negotiation.cc:299] Negotiation successful
0808 14:57:08.416758 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2656,"thread_start_us":2520,"threads_started":1}
I20260808 14:57:08.418609 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:08.399211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:36691)
0808 14:57:08.400166 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:08.400215 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:08.402200 (+ 1985us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:08.402897 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:08.402905 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:08.403398 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:08.403930 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:08.403947 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:08.404970 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:08.404975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:08.406226 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:08.406238 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:08.407048 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:08.407056 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:08.407287 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:08.408025 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:08.408047 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:08.410233 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:08.413932 (+ 3699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:08.413944 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:08.413961 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:08.414570 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:08.414965 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:08.414972 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:08.414979 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:08.415232 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:08.415731 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:08.415742 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:08.416188 (+ 446us) client_negotiation.cc:769] Sending connection context
0808 14:57:08.416485 (+ 297us) client_negotiation.cc:240] Negotiation successful
0808 14:57:08.417114 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":379,"threads_started":1}
I20260808 14:57:08.420094 27152 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33113
I20260808 14:57:08.420446 27152 heartbeater.cc:464] Registering TS with master...
I20260808 14:57:08.421243 27152 heartbeater.cc:511] Master 127.12.73.190:33113 requested a full tablet report, sending...
I20260808 14:57:08.422752 26635 ts_manager.cc:194] Registered new tserver with Master: 39ce506080fe43249fef17cf53241e4d (127.12.73.130:41397)
I20260808 14:57:08.423557 26635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:36691
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:57:08.462638 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33113
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:40459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:57:08.809442 27160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:08.809742 27160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:08.809906 27160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:08.817912 27160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:08.818053 27160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:08.818233 27160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:57:08.828298 27160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:08.829725 27160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:08.831037 27160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:08.845041 27169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:08.845232 27171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:08.845513 27168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:08.845922 27160 server_base.cc:1034] running on GCE node
I20260808 14:57:08.846583 27160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:08.847630 27160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:08.848965 27160 hybrid_clock.cc:648] HybridClock initialized: now 1786201028848905 us; error 48 us; skew 500 ppm
I20260808 14:57:08.849356 27160 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:57:08 dist-test-slave-z8x9 krb5kdc[26556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:57:08.852519 27160 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:57:08.854151 27160 webserver.cc:460] Webserver started at http://127.12.73.131:33183/ using document root <none> and password file <none>
I20260808 14:57:08.855043 27160 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:08.855202 27160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:08.855538 27160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:08.858592 27160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "306100de10fe45ae9783b539f54cf276"
format_stamp: "Formatted at 2026-08-08 14:57:08 on dist-test-slave-z8x9"
server_key: "1b032ed8dc8be2e2da7e80532d0b088d"
server_key_iv: "f5049cc73d171b95abc7213dd937b282"
server_key_version: "encryptionkey@0"
I20260808 14:57:08.859390 27160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "306100de10fe45ae9783b539f54cf276"
format_stamp: "Formatted at 2026-08-08 14:57:08 on dist-test-slave-z8x9"
server_key: "1b032ed8dc8be2e2da7e80532d0b088d"
server_key_iv: "f5049cc73d171b95abc7213dd937b282"
server_key_version: "encryptionkey@0"
I20260808 14:57:08.864413 27160 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260808 14:57:08.867952 27178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:08.869364 27160 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:57:08.869530 27160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "306100de10fe45ae9783b539f54cf276"
format_stamp: "Formatted at 2026-08-08 14:57:08 on dist-test-slave-z8x9"
server_key: "1b032ed8dc8be2e2da7e80532d0b088d"
server_key_iv: "f5049cc73d171b95abc7213dd937b282"
server_key_version: "encryptionkey@0"
I20260808 14:57:08.869751 27160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:08.894445 27160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:08.898581 27160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:08.898895 27160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:08.899854 27160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:08.901111 26943 heartbeater.cc:503] Master 127.12.73.190:33113 was elected leader, sending a full tablet report...
I20260808 14:57:08.901511 27160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:08.901621 27160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:08.901762 27160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:08.901830 27160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:08.937358 27160 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:37891
I20260808 14:57:08.937397 27352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:37891 every 8 connection(s)
I20260808 14:57:08.938632 27160 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:57:08.939608 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 27160
I20260808 14:57:08.939798 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:57:08.940408 12582 external_mini_cluster.cc:1428] Setting key 312904f2f6a1c8c8f054aa79072122a7
Aug 08 14:57:08 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:57:08.960515 27357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:08.941601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:48071 (local address 127.12.73.190:33113)
0808 14:57:08.942186 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:08.942192 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:08.943267 (+ 1075us) server_negotiation.cc:407] Connection header received
0808 14:57:08.945463 (+ 2196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:08.945468 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:08.945561 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:08.945685 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:08.947184 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:08.947980 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:08.949624 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:08.950034 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:08.950186 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:08.953997 (+ 3811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:08.954002 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:08.954006 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:08.954036 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:08.957370 (+ 3334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:08.958114 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:08.958119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:08.958123 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:08.958261 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:08.958717 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:08.958722 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:08.958725 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:08.959014 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:08.959194 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:08.959901 (+ 707us) server_negotiation.cc:299] Negotiation successful
0808 14:57:08.960118 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":304,"threads_started":1}
I20260808 14:57:08.961520 27359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:08.942182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:48071)
0808 14:57:08.943055 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:08.943153 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:08.945119 (+ 1966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:08.945944 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:08.945952 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:08.946456 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:08.947003 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:08.947020 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:08.948161 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:08.948171 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:08.949471 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:08.949485 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:08.950269 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:08.950277 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:08.950536 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:08.951342 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:08.951365 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:08.953781 (+ 2416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:08.957510 (+ 3729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:08.957518 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:08.957534 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:08.957974 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:08.958381 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:08.958386 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:08.958389 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:08.958590 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:08.959156 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:08.959163 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:08.959496 (+ 333us) client_negotiation.cc:769] Sending connection context
0808 14:57:08.959765 (+ 269us) client_negotiation.cc:240] Negotiation successful
0808 14:57:08.960319 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":322,"threads_started":1}
I20260808 14:57:08.963012 27354 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33113
I20260808 14:57:08.963340 27354 heartbeater.cc:464] Registering TS with master...
I20260808 14:57:08.964066 27354 heartbeater.cc:511] Master 127.12.73.190:33113 requested a full tablet report, sending...
I20260808 14:57:08.965508 26635 ts_manager.cc:194] Registered new tserver with Master: 306100de10fe45ae9783b539f54cf276 (127.12.73.131:37891)
I20260808 14:57:08.966338 26635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:48071
I20260808 14:57:08.968984 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab.
Entry for principal oryx/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab.
WARNING: no policy specified for oryx/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab.
Entry for principal oryx/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab.
WARNING: no policy specified for oryx/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab.
Entry for principal oryx/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab.
I20260808 14:57:09.139480 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 26729
Aug 08 14:57:09 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:57:09.156885 27374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:09.140917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35822 (local address 127.12.73.129:42175)
0808 14:57:09.141739 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:09.141748 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:09.141786 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:57:09.141865 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:09.141872 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:09.142095 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:09.142258 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:09.143843 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:09.145002 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:09.146386 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:09.146927 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:09.147025 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:09.151529 (+ 4504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:09.151539 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:09.151553 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:09.151585 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:09.154549 (+ 2964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:09.155173 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:09.155180 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:09.155183 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:09.155334 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:09.155656 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:09.155659 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:09.155661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:09.155979 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:09.156253 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:09.156416 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 14:57:09.156604 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":401,"threads_started":1}
I20260808 14:57:09.158206 26935 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:09.249854 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 26729
I20260808 14:57:09.274755 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 26951
Aug 08 14:57:09 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:57:09.290566 27376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:09.275719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56712 (local address 127.12.73.130:41397)
0808 14:57:09.276334 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:09.276341 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:09.276367 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:57:09.276428 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:09.276434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:09.276641 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:09.276789 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:09.278098 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:09.279168 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:09.280409 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:09.280991 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:09.281096 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:09.285315 (+ 4219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:09.285326 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:09.285340 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:09.285372 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:09.288084 (+ 2712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:09.288658 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:09.288665 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:09.288667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:09.288798 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:09.289111 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:09.289115 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:09.289116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:09.289500 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:09.289752 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:09.289986 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 14:57:09.290208 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":317,"threads_started":1}
I20260808 14:57:09.291833 27140 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:09.374203 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 26951
I20260808 14:57:09.398763 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 27160
Aug 08 14:57:09 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:57:09.415814 27379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:09.399914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45538 (local address 127.12.73.131:37891)
0808 14:57:09.400457 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:09.400464 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:09.400494 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:57:09.400555 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:09.400561 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:09.400765 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:09.400890 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:09.402257 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:09.403268 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:09.404544 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:09.405078 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:09.405255 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:09.409996 (+ 4741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:09.410007 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:09.410022 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:09.410055 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:09.413004 (+ 2949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:09.413742 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:09.413749 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:09.413751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:09.413871 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:09.414238 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:09.414241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:09.414243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:09.414581 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:09.414807 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:09.415184 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 14:57:09.415397 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":253,"threads_started":1}
I20260808 14:57:09.417085 27345 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:09.500254 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 27160
I20260808 14:57:09.525673 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 26579
I20260808 14:57:09.526896 26674 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:09.631276 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 26579
I20260808 14:57:09.659216 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33113
--webserver_interface=127.12.73.190
--webserver_port=44927
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:40459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:33113
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:57:10.002786 27382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:10.003083 27382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:10.003175 27382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:10.010404 27382 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:57:10.010522 27382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:10.010573 27382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:10.010624 27382 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:57:10.010661 27382 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:57:10.020969 27382 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:33113
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=44927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:10.022325 27382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:10.023617 27382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:10.035528 27387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:10.035722 27388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:10.035729 27390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:10.036587 27382 server_base.cc:1034] running on GCE node
I20260808 14:57:10.037498 27382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:10.038879 27382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:10.040130 27382 hybrid_clock.cc:648] HybridClock initialized: now 1786201030040088 us; error 46 us; skew 500 ppm
I20260808 14:57:10.040503 27382 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:57:10 dist-test-slave-z8x9 krb5kdc[26556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201030, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:57:10.043836 27382 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:57:10.045367 27382 webserver.cc:460] Webserver started at http://127.12.73.190:44927/ using document root <none> and password file <none>
I20260808 14:57:10.046005 27382 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:10.046118 27382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:10.051345 27382 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 14:57:10.054049 27400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:10.055332 27382 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:57:10.055511 27382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "f4299e91940a4643a342d3bf5b941246"
format_stamp: "Formatted at 2026-08-08 14:57:07 on dist-test-slave-z8x9"
server_key: "a9f64f4ddd81e1ef8a6415fdb647a638"
server_key_iv: "b1b9f246116cf8cee194b7a688b3e2c9"
server_key_version: "encryptionkey@0"
I20260808 14:57:10.056488 27382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:10.080644 27382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:10.085397 27382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:10.085703 27382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:10.105366 27382 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:33113
I20260808 14:57:10.105399 27483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:33113 every 8 connection(s)
I20260808 14:57:10.106951 27382 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:57:10.114213 27484 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:57:10.117599 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 27382
I20260808 14:57:10.117861 27484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246: Bootstrap starting.
I20260808 14:57:10.118678 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:42175
--local_ip_for_outbound_sockets=127.12.73.129
--tserver_master_addrs=127.12.73.190:33113
--webserver_port=41107
--webserver_interface=127.12.73.129
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:40459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.73.129
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:57:10.140750 27484 log.cc:824] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246: Log is configured to *not* fsync() on all Append() calls
I20260808 14:57:10.149942 27484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:57:10.150504 27484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246: Bootstrap complete.
I20260808 14:57:10.160193 27484 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4299e91940a4643a342d3bf5b941246" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33113 } }
I20260808 14:57:10.161233 27484 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4299e91940a4643a342d3bf5b941246, State: Initialized, Role: FOLLOWER
I20260808 14:57:10.162000 27484 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4299e91940a4643a342d3bf5b941246" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33113 } }
I20260808 14:57:10.162266 27484 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:57:10.162413 27484 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:57:10.162611 27484 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:57:10.166605 27484 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4299e91940a4643a342d3bf5b941246" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33113 } }
I20260808 14:57:10.167165 27484 leader_election.cc:302] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4299e91940a4643a342d3bf5b941246; no voters:
I20260808 14:57:10.167894 27484 leader_election.cc:288] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:57:10.168058 27488 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:57:10.169363 27488 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [term 2 LEADER]: Becoming Leader. State: Replica: f4299e91940a4643a342d3bf5b941246, State: Running, Role: LEADER
I20260808 14:57:10.170006 27488 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4299e91940a4643a342d3bf5b941246" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33113 } }
I20260808 14:57:10.170392 27484 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:57:10.172658 27491 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4299e91940a4643a342d3bf5b941246. Latest consensus state: current_term: 2 leader_uuid: "f4299e91940a4643a342d3bf5b941246" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4299e91940a4643a342d3bf5b941246" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33113 } } }
I20260808 14:57:10.173039 27491 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [sys.catalog]: This master's current role is: LEADER
I20260808 14:57:10.173828 27489 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f4299e91940a4643a342d3bf5b941246" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4299e91940a4643a342d3bf5b941246" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33113 } } }
I20260808 14:57:10.174180 27489 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246 [sys.catalog]: This master's current role is: LEADER
I20260808 14:57:10.185916 27499 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:57:10.192492 27499 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:57:10.193950 27499 catalog_manager.cc:1259] Loaded cluster ID: e9a28535806d452ea4692a15e7cc0761
I20260808 14:57:10.194175 27499 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:57:10.198064 27499 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:57:10.199529 27499 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f4299e91940a4643a342d3bf5b941246: Loaded TSK: 0
I20260808 14:57:10.201081 27499 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:57:10.476583 27486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:10.476922 27486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:10.477084 27486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:10.484357 27486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:10.484532 27486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:10.484712 27486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:57:10.494632 27486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.129.keytab
--principal=oryx/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:42175
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=41107
--tserver_master_addrs=127.12.73.190:33113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:10.495988 27486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:10.497417 27486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:10.510977 27519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:10.510946 27521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:10.511801 27486 server_base.cc:1034] running on GCE node
W20260808 14:57:10.511979 27517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:10.512666 27486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:10.513752 27486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:10.514986 27486 hybrid_clock.cc:648] HybridClock initialized: now 1786201030514934 us; error 47 us; skew 500 ppm
I20260808 14:57:10.515303 27486 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:57:10 dist-test-slave-z8x9 krb5kdc[26556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201030, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:57:10.518644 27486 init.cc:377] Logged in from keytab as oryx/127.12.73.129@KRBTEST.COM (short username oryx)
I20260808 14:57:10.520263 27486 webserver.cc:460] Webserver started at http://127.12.73.129:41107/ using document root <none> and password file <none>
I20260808 14:57:10.520974 27486 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:10.521130 27486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:10.526947 27486 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20260808 14:57:10.529986 27529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:10.531351 27486 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:57:10.531559 27486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "ba51454b97e4454ab3b014b394359768"
format_stamp: "Formatted at 2026-08-08 14:57:07 on dist-test-slave-z8x9"
server_key: "3cfc54be9ee1b0ff61f13af2c5d93d9e"
server_key_iv: "0433e33ee30a23c8ba1e3bc663085c34"
server_key_version: "encryptionkey@0"
I20260808 14:57:10.532538 27486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:10.554175 27486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:10.558683 27486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:10.558979 27486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:10.560036 27486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:10.561559 27486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:10.561685 27486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:10.561829 27486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:10.561929 27486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:10.596026 27486 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:42175
I20260808 14:57:10.596123 27693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:42175 every 8 connection(s)
I20260808 14:57:10.597620 27486 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:57:10.599570 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 27486
I20260808 14:57:10.600310 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:41397
--local_ip_for_outbound_sockets=127.12.73.130
--tserver_master_addrs=127.12.73.190:33113
--webserver_port=44023
--webserver_interface=127.12.73.130
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:40459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.73.130
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:57:10 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:10 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:57:11.019318 27700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:11.019685 27700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:11.019857 27700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:11.027045 27700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:11.027192 27700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:11.027364 27700 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:57:11.037487 27700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.130.keytab
--principal=oryx/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:41397
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=44023
--tserver_master_addrs=127.12.73.190:33113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:11.038779 27700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:11.040100 27700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:11.054456 27711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:11.055130 27710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:11.054669 27714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:11.056346 27700 server_base.cc:1034] running on GCE node
I20260808 14:57:11.057021 27700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:11.058143 27700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:11.059376 27700 hybrid_clock.cc:648] HybridClock initialized: now 1786201031059315 us; error 53 us; skew 500 ppm
I20260808 14:57:11.059698 27700 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:57:11 dist-test-slave-z8x9 krb5kdc[26556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201031, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:57:11.063762 27700 init.cc:377] Logged in from keytab as oryx/127.12.73.130@KRBTEST.COM (short username oryx)
I20260808 14:57:11.065511 27700 webserver.cc:460] Webserver started at http://127.12.73.130:44023/ using document root <none> and password file <none>
I20260808 14:57:11.066227 27700 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:11.066406 27700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:11.072492 27700 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.005s
I20260808 14:57:11.075543 27723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:11.077052 27700 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 14:57:11.077302 27700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "39ce506080fe43249fef17cf53241e4d"
format_stamp: "Formatted at 2026-08-08 14:57:08 on dist-test-slave-z8x9"
server_key: "a0a755d097bf7d4b8e16c9b8a799200f"
server_key_iv: "93bae17bf8847aa704f024a644b768f3"
server_key_version: "encryptionkey@0"
I20260808 14:57:11.078275 27700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:11.101625 27700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:11.106413 27700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:11.106709 27700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:11.107839 27700 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:11.109395 27700 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:11.109529 27700 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:11.109688 27700 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:11.109789 27700 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:11.192865 27700 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:41397
I20260808 14:57:11.192924 27886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:41397 every 8 connection(s)
I20260808 14:57:11.194633 27700 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:57:11.203012 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 27700
I20260808 14:57:11.204082 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:37891
--local_ip_for_outbound_sockets=127.12.73.131
--tserver_master_addrs=127.12.73.190:33113
--webserver_port=33183
--webserver_interface=127.12.73.131
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:40459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.73.131
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:57:11 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:11 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:57:11.912286 27895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:11.912879 27895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:11.913188 27895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:11.916757 27696 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.304s user 0.002s sys 0.012s
I20260808 14:57:11.918907 27696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:10.600900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:32867)
0808 14:57:10.601715 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:10.601770 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:10.603475 (+ 1705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:10.606767 (+ 3292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:10.606779 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:10.607396 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:10.607914 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:10.607932 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:10.609575 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:10.609584 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:10.610750 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:10.610762 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:10.611891 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:10.611897 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:10.612095 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:10.612826 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:10.612852 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:11.917689 (+1304837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":353,"threads_started":1}
W20260808 14:57:11.919111 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:10.600945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:32867 (local address 127.12.73.190:33113)
0808 14:57:10.605609 (+ 4664us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:10.605620 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:10.605658 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:57:10.605943 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:10.605955 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:10.606253 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:10.606624 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:10.608125 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:10.609404 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:10.610912 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:10.611650 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:10.611838 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:11.918081 (+1306243us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:32867: BlockingRecv error: recv got EOF from 127.12.73.129:32867 (error 108)
Metrics: {"server-negotiator.queue_time_us":4459,"thread_start_us":4280,"threads_started":1}
W20260808 14:57:11.920477 27694 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:33113 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.73.190:33113: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
W20260808 14:57:11.928470 27895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:11.928627 27895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:11.928864 27895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
Aug 08 14:57:11 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:11 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:57:11.933951 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:11.921828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:58067 (local address 127.12.73.190:33113)
0808 14:57:11.921991 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:11.921998 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:11.922409 (+ 411us) server_negotiation.cc:407] Connection header received
0808 14:57:11.922477 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:11.922483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:11.922565 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:11.922651 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:11.923703 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:11.924812 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:11.926709 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:11.927323 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:11.927439 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:11.933703 (+ 6264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:58067: BlockingRecv error: recv got EOF from 127.12.73.129:58067 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:57:11.934710 27696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:11.921422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:58067)
0808 14:57:11.922146 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:11.922165 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:11.922287 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:11.922825 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:11.922829 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:11.923303 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:11.923529 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:11.923542 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:11.924986 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:11.924991 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:11.926543 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:11.926558 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:11.927661 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:11.927667 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:11.927832 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:11.928715 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:11.928741 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:11.934432 (+ 5691us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":599}
I20260808 14:57:11.943696 27895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/krb5kdc/oryx_127.12.73.131.keytab
--principal=oryx/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:37891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=33183
--tserver_master_addrs=127.12.73.190:33113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
Aug 08 14:57:11 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:11.945236 27895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
Aug 08 14:57:11 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:11.946835 27895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:57:11.949262 27696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:11.935738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:47097)
0808 14:57:11.936323 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:11.936353 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:11.936509 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:11.937025 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:11.937030 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:11.937495 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:11.937691 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:11.937703 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:11.939173 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:11.939178 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:11.940678 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:11.940691 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:11.941706 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:11.941716 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:11.942072 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:11.942915 (+ 843us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:11.942952 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:11.948783 (+ 5831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477}
W20260808 14:57:11.949283 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:11.936051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:47097 (local address 127.12.73.190:33113)
0808 14:57:11.936195 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:11.936201 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:11.936415 (+ 214us) server_negotiation.cc:407] Connection header received
0808 14:57:11.936642 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:11.936646 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:11.936716 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:11.936785 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:11.937856 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:11.938985 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:11.940833 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:11.941498 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:11.941616 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:11.949025 (+ 7409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:47097: BlockingRecv error: recv got EOF from 127.12.73.129:47097 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 14:57:11.950573 27694 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:57:11.963084 27907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:11.963061 27905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:11.964068 27904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:11.964834 27895 server_base.cc:1034] running on GCE node
I20260808 14:57:11.966006 27895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:11.967676 27895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:11.969051 27895 hybrid_clock.cc:648] HybridClock initialized: now 1786201031968958 us; error 52 us; skew 500 ppm
I20260808 14:57:11.969630 27895 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:57:11 dist-test-slave-z8x9 krb5kdc[26556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201031, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:57:11.975481 27895 init.cc:377] Logged in from keytab as oryx/127.12.73.131@KRBTEST.COM (short username oryx)
I20260808 14:57:11.978071 27895 webserver.cc:460] Webserver started at http://127.12.73.131:33183/ using document root <none> and password file <none>
I20260808 14:57:11.979435 27895 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:11.979674 27895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:11.989663 27895 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 14:57:11.994380 27917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:11.996577 27895 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:57:11.996871 27895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "306100de10fe45ae9783b539f54cf276"
format_stamp: "Formatted at 2026-08-08 14:57:08 on dist-test-slave-z8x9"
server_key: "1b032ed8dc8be2e2da7e80532d0b088d"
server_key_iv: "f5049cc73d171b95abc7213dd937b282"
server_key_version: "encryptionkey@0"
I20260808 14:57:11.998980 27895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:12.040074 27895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:12.047900 27895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:12.048346 27895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:12.050056 27895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:12.052592 27895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:12.052762 27895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:12.052928 27895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:12.053056 27895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:12.104228 27895 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:37891
I20260808 14:57:12.104281 28102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:37891 every 8 connection(s)
I20260808 14:57:12.105822 27895 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:57:12.114511 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 27895
Aug 08 14:57:12 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:12 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:12.157514 28106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:12.115788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58526 (local address 127.12.73.190:33113)
0808 14:57:12.129727 (+ 13939us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:12.129737 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:12.131089 (+ 1352us) server_negotiation.cc:407] Connection header received
0808 14:57:12.131333 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:12.131342 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:12.131432 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:12.131551 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:12.133924 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.135844 (+ 1920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.138633 (+ 2789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.139181 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.139319 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:12.146819 (+ 7500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:12.146832 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:12.146852 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:12.146904 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:12.151751 (+ 4847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:12.152762 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:12.152777 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:12.152792 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:12.153134 (+ 342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:12.153666 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:12.153673 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:12.153679 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:12.154590 (+ 911us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:12.156190 (+ 1600us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:12.156483 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 14:57:12.156904 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13747,"thread_start_us":13587,"threads_started":1}
W20260808 14:57:12.454285 27893 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.226s user 0.001s sys 0.014s
W20260808 14:57:12.455700 27892 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:11.197749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:51219 (local address 127.12.73.190:33113)
0808 14:57:11.198327 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:11.198334 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:11.199441 (+ 1107us) server_negotiation.cc:407] Connection header received
0808 14:57:11.218870 (+ 19429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:11.218880 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:11.219019 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:11.219170 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:11.222728 (+ 3558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:11.224442 (+ 1714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:11.226283 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:11.226733 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:11.226883 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:12.455342 (+1228459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:51219: BlockingRecv error: recv got EOF from 127.12.73.130:51219 (error 108)
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":298,"threads_started":1}
I20260808 14:57:12.456295 27893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:11.198055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:51219)
0808 14:57:11.199196 (+ 1141us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:11.199281 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:11.218074 (+ 18793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:11.219964 (+ 1890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:11.219984 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:11.221162 (+ 1178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:11.222371 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:11.222406 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:11.224673 (+ 2267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:11.224678 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:11.226060 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:11.226073 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:11.227009 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:11.227016 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:11.227273 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:11.228090 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:11.228117 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:12.455143 (+1227026us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":394,"threads_started":1}
W20260808 14:57:12.457676 27890 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:33113 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.73.190:33113: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Aug 08 14:57:12 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:12 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:12.469127 27893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:12.458547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:55845)
0808 14:57:12.458836 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:12.458864 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:12.459032 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:12.459464 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:12.459469 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:12.460060 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:12.460271 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:12.460282 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.461616 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.461621 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:12.462590 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:12.462601 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.463383 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.463389 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:12.463558 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:12.464342 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:12.464360 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:12.468825 (+ 4465us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":86}
W20260808 14:57:12.469300 27892 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:12.458855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:55845 (local address 127.12.73.190:33113)
0808 14:57:12.459025 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:12.459031 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:12.459053 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:57:12.459210 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:12.459218 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:12.459311 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:12.459432 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:12.460418 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.461465 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.462755 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.463199 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.463340 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:12.469030 (+ 5690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:55845: BlockingRecv error: recv got EOF from 127.12.73.130:55845 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 14:57:12 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:12 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:12.479774 27893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:12.470739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:51341)
0808 14:57:12.470954 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:12.470969 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:12.471046 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:12.471516 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:12.471520 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:12.471861 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:12.472076 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:12.472087 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.473447 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.473453 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:12.474527 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:12.474539 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.475289 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.475295 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:12.475494 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:12.476202 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:12.476218 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:12.479481 (+ 3263us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125}
W20260808 14:57:12.479984 27892 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:12.471025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:51341 (local address 127.12.73.190:33113)
0808 14:57:12.471250 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:12.471255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:12.471271 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:57:12.471318 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:12.471321 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:12.471372 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:12.471477 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:12.472223 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.473288 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.474674 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.475125 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.475274 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:12.479702 (+ 4428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:51341: BlockingRecv error: recv got EOF from 127.12.73.130:51341 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 14:57:12.480372 27890 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 14:57:12 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:12 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:57:12.963016 27892 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:12.951338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:47951 (local address 127.12.73.190:33113)
0808 14:57:12.951512 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:12.951517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:12.952039 (+ 522us) server_negotiation.cc:407] Connection header received
0808 14:57:12.952248 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:12.952259 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:12.952331 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:12.952439 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:12.953317 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.954009 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.955282 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.955851 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.956032 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:12.962839 (+ 6807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:47951: BlockingRecv error: recv got EOF from 127.12.73.129:47951 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:57:12.963274 28113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:12.951302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:47951)
0808 14:57:12.951918 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:12.951934 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:12.952101 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:12.952478 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:12.952483 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:12.952968 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:12.953125 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:12.953135 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.954160 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.954166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:12.955134 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:12.955146 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.956155 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.956166 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:12.956476 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:12.957352 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:12.957375 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:12.962673 (+ 5298us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":374,"threads_started":1}
W20260808 14:57:13.297634 28109 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.153s user 0.002s sys 0.016s
W20260808 14:57:13.298888 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:12.115645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:42179 (local address 127.12.73.190:33113)
0808 14:57:12.116060 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:12.116066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:12.130324 (+ 14258us) server_negotiation.cc:407] Connection header received
0808 14:57:12.133078 (+ 2754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:12.133087 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:12.133216 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:12.133357 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:12.134992 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.135764 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.137674 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.138099 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.138237 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:13.298632 (+1160395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:42179: BlockingRecv error: recv got EOF from 127.12.73.131:42179 (error 108)
Metrics: {"server-negotiator.queue_time_us":291}
I20260808 14:57:13.299732 28109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:12.116292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:42179)
0808 14:57:12.130108 (+ 13816us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:12.130165 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:12.132697 (+ 2532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:12.133631 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:12.133645 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:12.134270 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:12.134819 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:12.134836 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.136052 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.136060 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:12.137521 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:12.137534 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:12.138367 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:12.138377 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:12.138640 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:12.144410 (+ 5770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:12.144446 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:13.298475 (+1154029us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":13497,"thread_start_us":13257,"threads_started":1}
W20260808 14:57:13.300691 28104 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:33113 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.73.190:33113: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Aug 08 14:57:13 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:13 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:13.311053 28109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:13.301397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:46629)
0808 14:57:13.301589 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:13.301617 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:13.301721 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:13.302074 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:13.302077 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:13.302437 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:13.302599 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:13.302607 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.303637 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.303651 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:13.304637 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:13.304656 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.305674 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.305683 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:13.305838 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:13.306528 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:13.306547 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:13.310748 (+ 4201us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 14:57:13.311225 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:13.301591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:46629 (local address 127.12.73.190:33113)
0808 14:57:13.301824 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:13.301829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:13.301845 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:57:13.301890 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:13.301894 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:13.301950 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:13.302032 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:13.302746 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.303513 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.304878 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.305433 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.305536 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:13.310971 (+ 5435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:46629: BlockingRecv error: recv got EOF from 127.12.73.131:46629 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Aug 08 14:57:13 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:13 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:13.319528 28109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:13.311834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:43347)
0808 14:57:13.311979 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:13.311996 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:13.312090 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:13.312415 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:13.312419 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:13.312712 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:13.312865 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:13.312872 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.313922 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.313926 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:13.314904 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:13.314917 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.315524 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.315528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:13.315649 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:13.316185 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:13.316208 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:13.319339 (+ 3131us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 14:57:13.319726 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:13.311901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:43347 (local address 127.12.73.190:33113)
0808 14:57:13.312049 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:13.312053 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:13.312069 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:57:13.312185 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:13.312188 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:13.312242 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:13.312319 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:13.312989 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.313775 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.315027 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.315396 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.315483 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:13.319530 (+ 4047us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:43347: BlockingRecv error: recv got EOF from 127.12.73.131:43347 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 14:57:13.319875 28104 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 14:57:13 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:13 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:13.490700 28119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:13.480944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:44309)
0808 14:57:13.481599 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:13.481621 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:13.481747 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:13.482031 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:13.482034 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:13.482449 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:13.482719 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:13.482730 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.483717 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.483721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:13.484711 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:13.484722 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.485492 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.485497 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:13.485618 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:13.486263 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:13.486280 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:13.490349 (+ 4069us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":398,"threads_started":1}
W20260808 14:57:13.490804 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:13.481029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:44309 (local address 127.12.73.190:33113)
0808 14:57:13.481280 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:13.481285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:13.481708 (+ 423us) server_negotiation.cc:407] Connection header received
0808 14:57:13.481829 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:13.481833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:13.481902 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:13.481983 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:13.482855 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.483552 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.484841 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.485327 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.485421 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:13.490552 (+ 5131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:44309: BlockingRecv error: recv got EOF from 127.12.73.130:44309 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 14:57:13 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:13 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:57:13.973503 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:13.964305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:53741 (local address 127.12.73.190:33113)
0808 14:57:13.964539 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:13.964549 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:13.964843 (+ 294us) server_negotiation.cc:407] Connection header received
0808 14:57:13.964972 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:13.964976 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:13.965035 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:13.965113 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:13.966019 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.966743 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.968002 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.968442 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.968531 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:13.973279 (+ 4748us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:53741: BlockingRecv error: recv got EOF from 127.12.73.129:53741 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:57:13.973529 28122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:13.964275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:53741)
0808 14:57:13.964742 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:13.964759 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:13.964874 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:13.965284 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:13.965288 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:13.965707 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:13.965889 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:13.965898 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.966887 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.966891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:13.967879 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:13.967891 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:13.968580 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:13.968584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:13.968705 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:13.969350 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:13.969367 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:13.973047 (+ 3680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":271,"threads_started":1}
Aug 08 14:57:14 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:14 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:14.329610 28123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:14.320491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:38517)
0808 14:57:14.321101 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:14.321117 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:14.321287 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:14.321594 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:14.321597 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:14.322030 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:14.322175 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:14.322183 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:14.323176 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:14.323179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:14.324118 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:14.324129 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:14.324775 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:14.324779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:14.324892 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:14.325498 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:14.325516 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:14.329241 (+ 3725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":372,"threads_started":1}
W20260808 14:57:14.329731 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:14.320556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:38517 (local address 127.12.73.190:33113)
0808 14:57:14.320734 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:14.320739 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:14.321213 (+ 474us) server_negotiation.cc:407] Connection header received
0808 14:57:14.321393 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:14.321397 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:14.321469 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:14.321550 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:14.322297 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:14.323061 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:14.324248 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:14.324625 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:14.324724 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:14.329455 (+ 4731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:38517: BlockingRecv error: recv got EOF from 127.12.73.131:38517 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 14:57:14 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:14 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:14.500948 28124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:14.491888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:39211)
0808 14:57:14.492399 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:14.492422 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:14.492540 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:14.492826 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:14.492829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:14.493307 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:14.493497 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:14.493520 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:14.494501 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:14.494504 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:14.495421 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:14.495432 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:14.496232 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:14.496241 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:14.496453 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:14.497203 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:14.497221 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:14.500712 (+ 3491us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":296,"threads_started":1}
W20260808 14:57:14.501152 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:14.491937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:39211 (local address 127.12.73.190:33113)
0808 14:57:14.492127 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:14.492132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:14.492501 (+ 369us) server_negotiation.cc:407] Connection header received
0808 14:57:14.492636 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:14.492639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:14.492697 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:14.492778 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:14.493634 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:14.494364 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:14.495567 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:14.496048 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:14.496175 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:14.500916 (+ 4741us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:39211: BlockingRecv error: recv got EOF from 127.12.73.130:39211 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 14:57:14 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:14 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:14.983685 28125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:14.974444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:40137)
0808 14:57:14.974979 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:14.974996 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:14.975120 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:14.975452 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:14.975455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:14.975820 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:14.975986 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:14.975994 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:14.977082 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:14.977085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:14.978028 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:14.978040 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:14.978724 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:14.978728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:14.978860 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:14.979447 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:14.979465 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:14.983451 (+ 3986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":283,"threads_started":1}
W20260808 14:57:14.983856 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:14.974600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:40137 (local address 127.12.73.190:33113)
0808 14:57:14.974779 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:14.974784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:14.975066 (+ 282us) server_negotiation.cc:407] Connection header received
0808 14:57:14.975227 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:14.975230 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:14.975292 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:14.975397 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:14.976158 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:14.976943 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:14.978158 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:14.978597 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:14.978702 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:14.983637 (+ 4935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:40137: BlockingRecv error: recv got EOF from 127.12.73.129:40137 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 14:57:15 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:15 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:15.339612 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:15.330601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:47077)
0808 14:57:15.331090 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:15.331104 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:15.331268 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:15.331608 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:15.331613 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:15.332068 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:15.332249 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:15.332259 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:15.333359 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:15.333364 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:15.334284 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:15.334295 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:15.335015 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:15.335021 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:15.335203 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:15.335814 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:15.335832 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:15.339367 (+ 3535us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":279,"threads_started":1}
W20260808 14:57:15.339866 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:15.330660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:47077 (local address 127.12.73.190:33113)
0808 14:57:15.330885 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:15.330893 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:15.331214 (+ 321us) server_negotiation.cc:407] Connection header received
0808 14:57:15.331394 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:15.331405 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:15.331466 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:15.331569 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:15.332394 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:15.333157 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:15.334424 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:15.334859 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:15.334999 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:15.339605 (+ 4606us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:47077: BlockingRecv error: recv got EOF from 127.12.73.131:47077 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 14:57:15 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:15 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:15.510998 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:15.501891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:36379)
0808 14:57:15.502425 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:15.502453 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:15.502568 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:15.502850 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:15.502853 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:15.503219 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:15.503382 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:15.503391 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:15.504526 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:15.504531 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:15.505754 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:15.505767 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:15.506473 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:15.506479 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:15.506690 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:15.507362 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:15.507380 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:15.510768 (+ 3388us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":309,"threads_started":1}
W20260808 14:57:15.511186 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:15.501944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:36379 (local address 127.12.73.190:33113)
0808 14:57:15.502129 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:15.502134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:15.502528 (+ 394us) server_negotiation.cc:407] Connection header received
0808 14:57:15.502662 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:15.502666 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:15.502726 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:15.502804 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:15.503501 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:15.504362 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:15.505904 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:15.506317 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:15.506459 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:15.510964 (+ 4505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:36379: BlockingRecv error: recv got EOF from 127.12.73.130:36379 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 14:57:15 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:15 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:15.994465 28128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:15.984802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:33499)
0808 14:57:15.985395 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:15.985411 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:15.985561 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:15.985929 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:15.985933 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:15.986431 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:15.986597 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:15.986606 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:15.987646 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:15.987654 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:15.988664 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:15.988676 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:15.989472 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:15.989478 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:15.989666 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:15.990380 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:15.990402 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:15.994080 (+ 3678us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":296,"threads_started":1}
W20260808 14:57:15.994514 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:15.984920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:33499 (local address 127.12.73.190:33113)
0808 14:57:15.985147 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:15.985155 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:15.985497 (+ 342us) server_negotiation.cc:407] Connection header received
0808 14:57:15.985710 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:15.985714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:15.985774 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:15.985880 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:15.986752 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:15.987511 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:15.988813 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:15.989317 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:15.989449 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:15.994286 (+ 4837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:33499: BlockingRecv error: recv got EOF from 127.12.73.129:33499 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 14:57:16 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:16 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:16.350679 28129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:16.340743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:37653)
0808 14:57:16.341396 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:16.341413 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:16.341592 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:16.341952 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:16.341957 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:16.342358 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:16.342523 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:16.342533 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:16.343590 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:16.343596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:16.344518 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:16.344529 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:16.345276 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:16.345282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:16.345542 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:16.346175 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:16.346224 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:16.350438 (+ 4214us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":313,"threads_started":1}
W20260808 14:57:16.350874 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:16.340834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:37653 (local address 127.12.73.190:33113)
0808 14:57:16.341100 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:16.341108 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:16.341506 (+ 398us) server_negotiation.cc:407] Connection header received
0808 14:57:16.341741 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:16.341745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:16.341807 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:16.341915 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:16.342677 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:16.343432 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:16.344663 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:16.345079 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:16.345240 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:16.350636 (+ 5396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:37653: BlockingRecv error: recv got EOF from 127.12.73.131:37653 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 08 14:57:16 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:16 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:16.521611 28131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:16.511979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:56285)
0808 14:57:16.512513 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:16.512533 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:16.512654 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:16.512959 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:16.512963 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:16.513431 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:16.513618 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:16.513627 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:16.514771 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:16.514776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:16.516246 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:16.516258 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:16.516932 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:16.516936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:16.517052 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:16.517781 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:16.517798 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:16.521358 (+ 3560us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":301,"threads_started":1}
W20260808 14:57:16.521967 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:16.512170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:56285 (local address 127.12.73.190:33113)
0808 14:57:16.512412 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:16.512419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:16.512615 (+ 196us) server_negotiation.cc:407] Connection header received
0808 14:57:16.512765 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:16.512769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:16.512828 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:16.512909 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:16.513783 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:16.514579 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:16.516379 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:16.516780 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:16.516875 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:16.521558 (+ 4683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:56285: BlockingRecv error: recv got EOF from 127.12.73.130:56285 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 08 14:57:16 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:16 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:17.004968 28133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:16.995503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:39943)
0808 14:57:16.996084 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:16.996100 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:16.996268 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:16.996638 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:16.996643 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:16.997105 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:16.997405 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:16.997420 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:16.998740 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:16.998744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:16.999679 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:16.999691 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:17.000353 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:17.000357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:17.000491 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:17.001067 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:17.001084 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:17.004717 (+ 3633us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":323,"threads_started":1}
W20260808 14:57:17.005272 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:16.995727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:39943 (local address 127.12.73.190:33113)
0808 14:57:16.995968 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:16.995974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:16.996191 (+ 217us) server_negotiation.cc:407] Connection header received
0808 14:57:16.996420 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:16.996427 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:16.996493 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:16.996600 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:16.997559 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:16.998615 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:16.999814 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:17.000215 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:17.000315 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:17.004952 (+ 4637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:39943: BlockingRecv error: recv got EOF from 127.12.73.129:39943 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 08 14:57:17 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:17 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:17.365415 28134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:17.351886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:42107)
0808 14:57:17.352503 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:17.352519 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:17.352666 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:17.353093 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:17.353098 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:17.353585 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:17.353764 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:17.353774 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:17.354763 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:17.354767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:17.355771 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:17.355783 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:17.356418 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:17.356422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:17.356540 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:17.361074 (+ 4534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:17.361093 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:17.365044 (+ 3951us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":295,"threads_started":1}
W20260808 14:57:17.365523 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:17.351959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:42107 (local address 127.12.73.190:33113)
0808 14:57:17.352158 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:17.352165 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:17.352606 (+ 441us) server_negotiation.cc:407] Connection header received
0808 14:57:17.352798 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:17.352806 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:17.352915 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:17.353024 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:17.353908 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:17.354638 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:17.355894 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:17.356299 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:17.356390 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:17.365321 (+ 8931us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:42107: BlockingRecv error: recv got EOF from 127.12.73.131:42107 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 14:57:17 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:17 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:17.531781 28137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:17.522469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:47625)
0808 14:57:17.523014 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:17.523035 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:17.523147 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:17.523450 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:17.523454 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:17.523900 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:17.524052 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:17.524061 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:17.525052 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:17.525056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:17.526032 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:17.526044 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:17.526720 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:17.526724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:17.526852 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:17.527503 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:17.527521 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:17.531421 (+ 3900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":299,"threads_started":1}
W20260808 14:57:17.531919 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:17.522754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:47625 (local address 127.12.73.190:33113)
0808 14:57:17.522937 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:17.522942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:17.523106 (+ 164us) server_negotiation.cc:407] Connection header received
0808 14:57:17.523242 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:17.523245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:17.523317 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:17.523399 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:17.524185 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:17.524935 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:17.526155 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:17.526583 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:17.526699 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:17.531682 (+ 4983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:47625: BlockingRecv error: recv got EOF from 127.12.73.130:47625 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 14:57:18 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:18 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:18.014887 28140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:18.006070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:43837)
0808 14:57:18.006640 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:18.006669 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:18.006779 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:18.007112 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:18.007116 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:18.007520 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:18.007694 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:18.007703 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:18.008761 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:18.008765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:18.009711 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:18.009723 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:18.010430 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:18.010434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:18.010563 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:18.011165 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:18.011183 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:18.014630 (+ 3447us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":337,"threads_started":1}
W20260808 14:57:18.015031 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:18.006108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:43837 (local address 127.12.73.190:33113)
0808 14:57:18.006331 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:18.006337 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:18.006729 (+ 392us) server_negotiation.cc:407] Connection header received
0808 14:57:18.006874 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:18.006879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:18.006973 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:18.007065 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:18.007822 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:18.008618 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:18.009835 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:18.010279 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:18.010384 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:18.014820 (+ 4436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:43837: BlockingRecv error: recv got EOF from 127.12.73.129:43837 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 08 14:57:18 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:18 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:18.375641 28141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:18.366292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:59149)
0808 14:57:18.366823 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:18.366850 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:18.367010 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:18.367353 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:18.367359 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:18.367859 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:18.368009 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:18.368018 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:18.369069 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:18.369075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:18.370165 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:18.370177 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:18.370973 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:18.370978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:18.371180 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:18.371772 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:18.371790 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:18.375329 (+ 3539us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":277,"threads_started":1}
W20260808 14:57:18.375869 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:18.366370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:59149 (local address 127.12.73.190:33113)
0808 14:57:18.366621 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:18.366629 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:18.366940 (+ 311us) server_negotiation.cc:407] Connection header received
0808 14:57:18.367135 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:18.367140 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:18.367210 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:18.367314 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:18.368158 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:18.368926 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:18.370301 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:18.370806 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:18.370947 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:18.375550 (+ 4603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:59149: BlockingRecv error: recv got EOF from 127.12.73.131:59149 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 08 14:57:18 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:18 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:18.542505 28144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:18.532787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:41471)
0808 14:57:18.533390 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:18.533413 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:18.533537 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:18.533825 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:18.533828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:18.534235 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:18.534421 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:18.534430 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:18.535521 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:18.535529 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:18.536554 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:18.536567 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:18.537348 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:18.537352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:18.537483 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:18.538063 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:18.538081 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:18.542075 (+ 3994us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":316,"threads_started":1}
W20260808 14:57:18.542586 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:18.532849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:41471 (local address 127.12.73.190:33113)
0808 14:57:18.533039 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:18.533043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:18.533496 (+ 453us) server_negotiation.cc:407] Connection header received
0808 14:57:18.533629 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:18.533632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:18.533705 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:18.533783 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:18.534552 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:18.535365 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:18.536724 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:18.537148 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:18.537316 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:18.542284 (+ 4968us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:41471: BlockingRecv error: recv got EOF from 127.12.73.130:41471 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 14:57:19 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:19 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:19.024708 28145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:19.015834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:57027)
0808 14:57:19.016449 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:19.016466 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:19.016581 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:19.016903 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:19.016906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:19.017442 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:19.017620 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:19.017630 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:19.018651 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:19.018655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:19.019596 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:19.019607 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:19.020293 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:19.020298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:19.020414 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:19.021036 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:19.021053 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:19.024459 (+ 3406us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":301,"threads_started":1}
W20260808 14:57:19.024884 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:19.016047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:57027 (local address 127.12.73.190:33113)
0808 14:57:19.016226 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:19.016231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:19.016541 (+ 310us) server_negotiation.cc:407] Connection header received
0808 14:57:19.016680 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:19.016683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:19.016749 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:19.016831 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:19.017760 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:19.018530 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:19.019717 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:19.020142 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:19.020268 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:19.024659 (+ 4391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:57027: BlockingRecv error: recv got EOF from 127.12.73.129:57027 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 14:57:19 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:19 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:19.386130 28146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:19.377000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:51207)
0808 14:57:19.377503 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:19.377519 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:19.377636 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:19.377931 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:19.377934 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:19.378325 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:19.378509 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:19.378518 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:19.379487 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:19.379490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:19.380411 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:19.380422 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:19.381211 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:19.381217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:19.381405 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:19.382251 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:19.382276 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:19.385809 (+ 3533us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":302,"threads_started":1}
W20260808 14:57:19.386322 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:19.377059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:51207 (local address 127.12.73.190:33113)
0808 14:57:19.377362 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:19.377370 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:19.377605 (+ 235us) server_negotiation.cc:407] Connection header received
0808 14:57:19.377737 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:19.377740 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:19.377804 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:19.377889 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:19.378655 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:19.379372 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:19.380550 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:19.381020 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:19.381207 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:19.386054 (+ 4847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:51207: BlockingRecv error: recv got EOF from 127.12.73.131:51207 (error 108)
Metrics: {"server-negotiator.queue_time_us":141}
Aug 08 14:57:19 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:19 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:19.553018 28147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:19.543585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:53803)
0808 14:57:19.544197 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:19.544219 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:19.544385 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:19.544734 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:19.544740 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:19.545259 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:19.545444 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:19.545454 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:19.546465 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:19.546477 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:19.547430 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:19.547442 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:19.548400 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:19.548407 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:19.548579 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:19.549283 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:19.549301 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:19.552644 (+ 3343us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":258,"threads_started":1}
W20260808 14:57:19.553099 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:19.543642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:53803 (local address 127.12.73.190:33113)
0808 14:57:19.543845 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:19.543869 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:19.544308 (+ 439us) server_negotiation.cc:407] Connection header received
0808 14:57:19.544509 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:19.544516 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:19.544582 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:19.544685 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:19.545587 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:19.546310 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:19.547573 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:19.548248 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:19.548372 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:19.552852 (+ 4480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:53803: BlockingRecv error: recv got EOF from 127.12.73.130:53803 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 08 14:57:20 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:20 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:20.034458 28148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:20.025699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:41049)
0808 14:57:20.026349 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:20.026366 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:20.026484 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:20.026767 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:20.026770 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:20.027176 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:20.027343 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:20.027351 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:20.028377 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:20.028381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:20.029348 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:20.029360 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:20.030073 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:20.030077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:20.030191 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:20.030887 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:20.030905 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:20.034211 (+ 3306us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":380,"threads_started":1}
W20260808 14:57:20.034744 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:20.025745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:41049 (local address 127.12.73.190:33113)
0808 14:57:20.025957 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:20.025968 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:20.026446 (+ 478us) server_negotiation.cc:407] Connection header received
0808 14:57:20.026566 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:20.026570 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:20.026637 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:20.026716 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:20.027492 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:20.028249 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:20.029486 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:20.029915 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:20.030013 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:20.034490 (+ 4477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:41049: BlockingRecv error: recv got EOF from 127.12.73.129:41049 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 08 14:57:20 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:20 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:20.396463 28151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:20.387212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:50541)
0808 14:57:20.387883 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:20.387899 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:20.388013 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:20.388357 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:20.388361 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:20.388784 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:20.388956 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:20.388965 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:20.390030 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:20.390033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:20.390987 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:20.390998 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:20.391706 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:20.391710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:20.391821 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:20.392466 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:20.392485 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:20.396073 (+ 3588us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":307,"threads_started":1}
W20260808 14:57:20.396504 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:20.387395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:50541 (local address 127.12.73.190:33113)
0808 14:57:20.387570 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:20.387575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:20.387975 (+ 400us) server_negotiation.cc:407] Connection header received
0808 14:57:20.388110 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:20.388113 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:20.388172 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:20.388261 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:20.389148 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:20.389901 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:20.391134 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:20.391573 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:20.391675 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:20.396266 (+ 4591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:50541: BlockingRecv error: recv got EOF from 127.12.73.131:50541 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 14:57:20 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:20 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:20.563709 28152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:20.554095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:49547)
0808 14:57:20.554684 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:20.554705 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:20.554824 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:20.555117 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:20.555120 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:20.555536 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:20.555703 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:20.555711 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:20.556857 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:20.556861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:20.557822 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:20.557832 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:20.558497 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:20.558502 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:20.558616 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:20.559394 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:20.559421 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:20.563457 (+ 4036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":319,"threads_started":1}
W20260808 14:57:20.563931 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:20.554157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:49547 (local address 127.12.73.190:33113)
0808 14:57:20.554366 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:20.554370 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:20.554806 (+ 436us) server_negotiation.cc:407] Connection header received
0808 14:57:20.554926 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:20.554930 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:20.554992 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:20.555074 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:20.555840 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:20.556731 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:20.557946 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:20.558345 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:20.558436 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:20.563659 (+ 5223us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:49547: BlockingRecv error: recv got EOF from 127.12.73.130:49547 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 08 14:57:21 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:21 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:21.045079 28153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:21.035468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:39831)
0808 14:57:21.036000 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:21.036016 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:21.036185 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:21.036598 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:21.036603 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:21.037067 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:21.037299 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:21.037309 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:21.038376 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:21.038382 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:21.039354 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:21.039366 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:21.040085 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:21.040091 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:21.040275 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:21.040983 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:21.041001 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:21.044768 (+ 3767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":289,"threads_started":1}
W20260808 14:57:21.045349 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:21.035525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:39831 (local address 127.12.73.190:33113)
0808 14:57:21.035761 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:21.035769 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:21.036109 (+ 340us) server_negotiation.cc:407] Connection header received
0808 14:57:21.036316 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:21.036322 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:21.036425 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:21.036549 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:21.037451 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:21.038223 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:21.039501 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:21.039925 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:21.040064 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:21.045004 (+ 4940us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:39831: BlockingRecv error: recv got EOF from 127.12.73.129:39831 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 14:57:21 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:21 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:21.406435 28154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:21.397646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:47061)
0808 14:57:21.398211 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:21.398228 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:21.398342 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:21.398643 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:21.398646 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:21.399061 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:21.399227 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:21.399236 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:21.400206 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:21.400210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:21.401129 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:21.401139 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:21.401946 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:21.401950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:21.402064 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:21.402665 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:21.402684 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:21.406023 (+ 3339us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":309,"threads_started":1}
W20260808 14:57:21.406620 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:21.397709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:47061 (local address 127.12.73.190:33113)
0808 14:57:21.397890 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:21.397895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:21.398305 (+ 410us) server_negotiation.cc:407] Connection header received
0808 14:57:21.398450 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:21.398454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:21.398513 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:21.398596 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:21.399353 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:21.400077 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:21.401317 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:21.401785 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:21.401878 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:21.406368 (+ 4490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:47061: BlockingRecv error: recv got EOF from 127.12.73.131:47061 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 14:57:21 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:21 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:21.574031 28155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:21.564712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:41427)
0808 14:57:21.565251 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:21.565273 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:21.565447 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:21.565787 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:21.565791 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:21.566251 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:21.566397 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:21.566406 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:21.567430 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:21.567437 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:21.568407 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:21.568430 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:21.569222 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:21.569228 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:21.569427 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:21.570008 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:21.570025 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:21.573797 (+ 3772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":274,"threads_started":1}
W20260808 14:57:21.574527 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:21.564732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:41427 (local address 127.12.73.190:33113)
0808 14:57:21.564964 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:21.564972 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:21.565377 (+ 405us) server_negotiation.cc:407] Connection header received
0808 14:57:21.565576 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:21.565583 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:21.565649 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:21.565753 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:21.566545 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:21.567283 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:21.568586 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:21.569042 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:21.569179 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:21.574044 (+ 4865us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:41427: BlockingRecv error: recv got EOF from 127.12.73.130:41427 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 08 14:57:22 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:22 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:22.055474 28156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:22.046343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:45053)
0808 14:57:22.046931 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:22.046953 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:22.047108 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:22.047411 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:22.047414 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:22.047828 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:22.047983 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:22.047992 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:22.048964 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:22.048968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:22.050031 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:22.050044 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:22.050799 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:22.050803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:22.050923 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:22.051528 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:22.051545 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:22.055109 (+ 3564us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":286,"threads_started":1}
W20260808 14:57:22.055541 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:22.046397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:45053 (local address 127.12.73.190:33113)
0808 14:57:22.046638 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:22.046665 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:22.047054 (+ 389us) server_negotiation.cc:407] Connection header received
0808 14:57:22.047225 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:22.047229 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:22.047288 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:22.047368 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:22.048130 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:22.048813 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:22.050259 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:22.050654 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:22.050755 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:22.055281 (+ 4526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:45053: BlockingRecv error: recv got EOF from 127.12.73.129:45053 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 14:57:22 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:22 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:22.421406 28157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:22.407611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:42515)
0808 14:57:22.408181 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:22.408198 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:22.408360 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:22.408723 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:22.408728 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:22.409231 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:22.409392 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:22.409401 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:22.410451 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:22.410457 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:22.411432 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:22.411444 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:22.412169 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:22.412175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:22.412367 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:22.417417 (+ 5050us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:22.417437 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:22.421012 (+ 3575us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":310,"threads_started":1}
W20260808 14:57:22.421530 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:22.407702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:42515 (local address 127.12.73.190:33113)
0808 14:57:22.407973 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:22.407982 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:22.408297 (+ 315us) server_negotiation.cc:407] Connection header received
0808 14:57:22.408490 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:22.408501 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:22.408562 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:22.408667 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:22.409547 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:22.410301 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:22.411582 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:22.412012 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:22.412153 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:22.421238 (+ 9085us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:42515: BlockingRecv error: recv got EOF from 127.12.73.131:42515 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
Aug 08 14:57:22 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:22 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:22.584352 28158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:22.574991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:48929)
0808 14:57:22.575597 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:22.575618 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:22.575733 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:22.576026 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:22.576029 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:22.576445 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:22.576622 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:22.576631 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:22.577764 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:22.577769 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:22.578792 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:22.578804 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:22.579493 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:22.579497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:22.579602 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:22.580185 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:22.580203 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:22.584073 (+ 3870us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":382,"threads_started":1}
W20260808 14:57:22.584441 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:22.575072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:48929 (local address 127.12.73.190:33113)
0808 14:57:22.575258 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:22.575263 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:22.575705 (+ 442us) server_negotiation.cc:407] Connection header received
0808 14:57:22.575832 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:22.575836 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:22.575898 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:22.575981 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:22.576759 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:22.577616 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:22.578930 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:22.579360 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:22.579457 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:22.584262 (+ 4805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:48929: BlockingRecv error: recv got EOF from 127.12.73.130:48929 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 14:57:23 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:23 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:23.066208 28159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:23.056525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:33815)
0808 14:57:23.057077 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:23.057093 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:23.057288 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:23.057615 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:23.057618 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:23.058030 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:23.058206 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:23.058215 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:23.059177 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:23.059180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:23.060572 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:23.060594 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:23.061645 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:23.061652 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:23.061833 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:23.062474 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:23.062492 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:23.065872 (+ 3380us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":313,"threads_started":1}
W20260808 14:57:23.066332 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:23.056695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:33815 (local address 127.12.73.190:33113)
0808 14:57:23.056970 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:23.056982 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:23.057254 (+ 272us) server_negotiation.cc:407] Connection header received
0808 14:57:23.057431 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:23.057435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:23.057500 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:23.057590 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:23.058333 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:23.059065 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:23.060722 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:23.061474 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:23.061611 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:23.066085 (+ 4474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:33815: BlockingRecv error: recv got EOF from 127.12.73.129:33815 (error 108)
Metrics: {"server-negotiator.queue_time_us":158}
Aug 08 14:57:23 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:23 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:23.432024 28160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:23.422565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:54113)
0808 14:57:23.423120 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:23.423136 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:23.423290 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:23.423652 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:23.423656 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:23.424095 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:23.424257 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:23.424266 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:23.425324 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:23.425330 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:23.426316 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:23.426328 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:23.427065 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:23.427072 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:23.427247 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:23.427884 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:23.427901 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:23.431670 (+ 3769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":312,"threads_started":1}
W20260808 14:57:23.432113 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:23.422669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:54113 (local address 127.12.73.190:33113)
0808 14:57:23.422938 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:23.422946 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:23.423226 (+ 280us) server_negotiation.cc:407] Connection header received
0808 14:57:23.423436 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:23.423442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:23.423512 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:23.423617 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:23.424409 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:23.425150 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:23.426472 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:23.426910 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:23.427049 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:23.431853 (+ 4804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:54113: BlockingRecv error: recv got EOF from 127.12.73.131:54113 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 08 14:57:23 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:23 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:23.594497 28162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:23.585467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:35323)
0808 14:57:23.586007 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:23.586029 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:23.586147 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:23.586487 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:23.586490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:23.587005 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:23.587187 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:23.587196 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:23.588247 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:23.588251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:23.589231 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:23.589253 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:23.589978 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:23.589983 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:23.590115 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:23.590837 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:23.590855 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:23.594269 (+ 3414us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":330,"threads_started":1}
W20260808 14:57:23.594725 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:23.585700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:35323 (local address 127.12.73.190:33113)
0808 14:57:23.585900 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:23.585906 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:23.586106 (+ 200us) server_negotiation.cc:407] Connection header received
0808 14:57:23.586261 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:23.586264 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:23.586323 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:23.586455 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:23.587346 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:23.588105 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:23.589371 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:23.589811 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:23.589918 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:23.594436 (+ 4518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:35323: BlockingRecv error: recv got EOF from 127.12.73.130:35323 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 14:57:24 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:24 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:24.076887 28163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:24.067359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:50867)
0808 14:57:24.067959 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:24.067976 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:24.068096 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:24.068382 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:24.068386 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:24.068824 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:24.069023 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:24.069032 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:24.070051 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:24.070055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:24.071067 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:24.071086 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:24.071874 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:24.071878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:24.072014 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:24.072628 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:24.072647 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:24.076601 (+ 3954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":351,"threads_started":1}
W20260808 14:57:24.077101 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:24.067412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:50867 (local address 127.12.73.190:33113)
0808 14:57:24.067595 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:24.067600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:24.068051 (+ 451us) server_negotiation.cc:407] Connection header received
0808 14:57:24.068195 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:24.068199 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:24.068256 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:24.068334 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:24.069149 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:24.069924 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:24.071207 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:24.071706 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:24.071799 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:24.076823 (+ 5024us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:50867: BlockingRecv error: recv got EOF from 127.12.73.129:50867 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 14:57:24 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:24 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:24.441944 28165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:24.433044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:40471)
0808 14:57:24.433601 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:24.433617 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:24.433733 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:24.434021 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:24.434024 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:24.434449 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:24.434646 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:24.434656 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:24.435647 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:24.435651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:24.436687 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:24.436700 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:24.437485 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:24.437489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:24.437618 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:24.438287 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:24.438305 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:24.441709 (+ 3404us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":333,"threads_started":1}
W20260808 14:57:24.442179 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:24.433131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:40471 (local address 127.12.73.190:33113)
0808 14:57:24.433371 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:24.433376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:24.433690 (+ 314us) server_negotiation.cc:407] Connection header received
0808 14:57:24.433829 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:24.433832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:24.433893 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:24.433974 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:24.434769 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:24.435516 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:24.436813 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:24.437346 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:24.437443 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:24.441908 (+ 4465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:40471: BlockingRecv error: recv got EOF from 127.12.73.131:40471 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 08 14:57:24 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:24 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:24.607501 28166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:24.595543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:33775)
0808 14:57:24.596108 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:24.596136 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:24.596252 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:24.596659 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:24.596662 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:24.597047 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:24.597318 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:24.597344 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:24.599076 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:24.599082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:24.600465 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:24.600478 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:24.601935 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:24.601942 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:24.602136 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:24.602926 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:24.602953 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:24.607130 (+ 4177us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":311,"threads_started":1}
W20260808 14:57:24.607810 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:24.595642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:33775 (local address 127.12.73.190:33113)
0808 14:57:24.595901 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:24.595909 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:24.596230 (+ 321us) server_negotiation.cc:407] Connection header received
0808 14:57:24.596379 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:24.596387 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:24.596504 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:24.596638 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:24.597499 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:24.598897 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:24.600613 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:24.601533 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:24.601687 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:24.607332 (+ 5645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:33775: BlockingRecv error: recv got EOF from 127.12.73.130:33775 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 08 14:57:25 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:25 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:25.087795 28167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:25.078160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:54521)
0808 14:57:25.078812 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:25.078828 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:25.078988 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:25.079354 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:25.079359 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:25.079821 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:25.079967 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:25.079977 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:25.080995 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:25.081000 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:25.082114 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:25.082127 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:25.082986 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:25.082992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:25.083176 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:25.083750 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:25.083767 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:25.087531 (+ 3764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":389,"threads_started":1}
W20260808 14:57:25.087950 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:25.078170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:54521 (local address 127.12.73.190:33113)
0808 14:57:25.078389 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:25.078399 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:25.078915 (+ 516us) server_negotiation.cc:407] Connection header received
0808 14:57:25.079137 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:25.079142 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:25.079221 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:25.079321 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:25.080111 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:25.080843 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:25.082262 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:25.082836 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:25.082970 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:25.087706 (+ 4736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:54521: BlockingRecv error: recv got EOF from 127.12.73.129:54521 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 14:57:25 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:25 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:25.452564 28170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:25.442903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:46399)
0808 14:57:25.443470 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:25.443487 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:25.443656 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:25.444046 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:25.444051 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:25.444530 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:25.444717 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:25.444727 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:25.445824 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:25.445832 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:25.446786 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:25.446798 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:25.447502 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:25.447507 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:25.447721 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:25.448546 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:25.448564 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:25.452304 (+ 3740us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":308,"threads_started":1}
W20260808 14:57:25.452736 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:25.442974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:46399 (local address 127.12.73.190:33113)
0808 14:57:25.443247 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:25.443257 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:25.443582 (+ 325us) server_negotiation.cc:407] Connection header received
0808 14:57:25.443803 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:25.443809 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:25.443880 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:25.443989 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:25.444868 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:25.445681 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:25.446928 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:25.447353 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:25.447490 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:25.452525 (+ 5035us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:46399: BlockingRecv error: recv got EOF from 127.12.73.131:46399 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 14:57:25 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:25 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:25.617473 28171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:25.608432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:59861)
0808 14:57:25.608939 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:25.608962 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:25.609120 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:25.609521 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:25.609526 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:25.610006 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:25.610158 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:25.610167 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:25.611242 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:25.611248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:25.612161 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:25.612172 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:25.612941 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:25.612948 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:25.613143 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:25.613736 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:25.613752 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:25.617226 (+ 3474us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":273,"threads_started":1}
W20260808 14:57:25.617632 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:25.608633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:59861 (local address 127.12.73.190:33113)
0808 14:57:25.608864 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:25.608870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:25.609049 (+ 179us) server_negotiation.cc:407] Connection header received
0808 14:57:25.609296 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:25.609300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:25.609379 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:25.609485 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:25.610333 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:25.611087 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:25.612313 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:25.612794 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:25.612935 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:25.617409 (+ 4474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:59861: BlockingRecv error: recv got EOF from 127.12.73.130:59861 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 08 14:57:26 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:26 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:26.098503 28175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:26.089217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:48397)
0808 14:57:26.089761 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:26.089778 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:26.089955 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:26.090450 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:26.090456 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:26.090859 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:26.091045 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:26.091054 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:26.092086 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:26.092092 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:26.093032 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:26.093044 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:26.093798 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:26.093804 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:26.093988 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:26.094597 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:26.094614 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:26.098234 (+ 3620us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":288,"threads_started":1}
W20260808 14:57:26.098711 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:26.089305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:48397 (local address 127.12.73.190:33113)
0808 14:57:26.089511 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:26.089518 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:26.089874 (+ 356us) server_negotiation.cc:407] Connection header received
0808 14:57:26.090239 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:26.090243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:26.090299 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:26.090406 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:26.091203 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:26.091929 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:26.093201 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:26.093637 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:26.093771 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:26.098453 (+ 4682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:48397: BlockingRecv error: recv got EOF from 127.12.73.129:48397 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 14:57:26 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:26 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.131@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:26.463042 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:26.453707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.131:41509)
0808 14:57:26.454318 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:26.454335 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:26.454453 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:26.454746 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:26.454750 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:26.455309 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:26.455462 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:26.455472 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:26.456538 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:26.456545 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:26.457491 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:26.457502 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:26.458261 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:26.458266 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:26.458435 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:26.459079 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:26.459098 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:26.462664 (+ 3566us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":376,"threads_started":1}
W20260808 14:57:26.463164 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:26.453801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:41509 (local address 127.12.73.190:33113)
0808 14:57:26.454115 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:26.454122 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:26.454423 (+ 301us) server_negotiation.cc:407] Connection header received
0808 14:57:26.454554 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:26.454557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:26.454618 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:26.454699 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:26.455621 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:26.456373 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:26.457641 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:26.458105 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:26.458245 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:26.462900 (+ 4655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.131:41509: BlockingRecv error: recv got EOF from 127.12.73.131:41509 (error 108)
Metrics: {"server-negotiator.queue_time_us":153}
Aug 08 14:57:26 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:26 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.130@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:26.627867 28178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:26.618669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.130:45193)
0808 14:57:26.619151 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:26.619172 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:26.619291 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:26.619593 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:26.619596 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:26.619967 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:26.620152 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:26.620160 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:26.621325 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:26.621336 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:26.622539 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:26.622552 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:26.623220 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:26.623224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:26.623346 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:26.623946 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:26.623963 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:26.627488 (+ 3525us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":267,"threads_started":1}
W20260808 14:57:26.627939 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:26.618740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:45193 (local address 127.12.73.190:33113)
0808 14:57:26.618977 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:26.618985 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:26.619252 (+ 267us) server_negotiation.cc:407] Connection header received
0808 14:57:26.619391 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:26.619395 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:26.619470 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:26.619549 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:26.620274 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:26.621134 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:26.622660 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:26.623100 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:26.623194 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:26.627700 (+ 4506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.130:45193: BlockingRecv error: recv got EOF from 127.12.73.130:45193 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 14:57:27 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:57:27 dist-test-slave-z8x9 krb5kdc[26556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.73.129@KRBTEST.COM for oryx/127.12.73.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:57:27.108639 28179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:27.099539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33113 (local address 127.12.73.129:48079)
0808 14:57:27.100125 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:27.100158 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:27.100273 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:27.100577 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:27.100580 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:27.101008 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:27.101241 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:27.101252 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:27.102244 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:27.102248 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:27.103189 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:27.103200 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:27.103869 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:27.103873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:27.103981 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:27.104557 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:27.104573 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:27.108281 (+ 3708us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.73.190:33113: Server oryx/127.12.73.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":337,"threads_started":1}
W20260808 14:57:27.108803 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:27.099597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:48079 (local address 127.12.73.190:33113)
0808 14:57:27.099761 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:27.099766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:27.100240 (+ 474us) server_negotiation.cc:407] Connection header received
0808 14:57:27.100367 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:27.100370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:27.100446 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:27.100528 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:27.101368 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:27.102124 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:27.103313 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:27.103745 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:27.103838 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:27.108519 (+ 4681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.73.129:48079: BlockingRecv error: recv got EOF from 127.12.73.129:48079 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:57:27.121249 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 27486
I20260808 14:57:27.133620 28181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:27.122383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45144 (local address 127.12.73.129:42175)
0808 14:57:27.122940 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:27.122946 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:27.122973 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:57:27.123032 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:27.123038 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:27.123277 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:27.123436 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:27.124844 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:27.126036 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:27.127205 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:27.127737 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:27.127837 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:27.130483 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:27.130492 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:27.130505 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:27.130541 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:27.132996 (+ 2455us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.73.129@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 14:57:27.133351 (+ 355us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45144: Request ticket server kudu/127.12.73.129@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":242,"threads_started":1}
W20260808 14:57:27.133728 28181 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45144: Request ticket server kudu/127.12.73.129@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 14:57:27.133715 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 27486: Not authorized: Client connection negotiation failed: client connection to 127.12.73.129:42175: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.73.129@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 14:57:27.133970 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 27486
I20260808 14:57:27.159636 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 27700
I20260808 14:57:27.172585 28182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:27.160932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36278 (local address 127.12.73.130:41397)
0808 14:57:27.161599 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:27.161607 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:27.161632 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:57:27.161693 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:27.161700 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:27.161948 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:27.162157 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:27.163487 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:27.164570 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:27.165901 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:27.166456 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:27.166612 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:27.169123 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:27.169131 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:27.169144 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:27.169231 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:27.171914 (+ 2683us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.73.130@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 14:57:27.172263 (+ 349us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36278: Request ticket server kudu/127.12.73.130@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":362,"threads_started":1}
W20260808 14:57:27.172627 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 27700: Not authorized: Client connection negotiation failed: client connection to 127.12.73.130:41397: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.73.130@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 14:57:27.172708 28182 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36278: Request ticket server kudu/127.12.73.130@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 14:57:27.172796 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 27700
I20260808 14:57:27.198889 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 27895
I20260808 14:57:27.212007 28183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:27.200060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55006 (local address 127.12.73.131:37891)
0808 14:57:27.200761 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:27.200771 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:27.200802 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:57:27.200904 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:27.200914 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:27.201318 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:27.201535 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:27.202809 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:27.204170 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:27.205492 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:27.206040 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:27.206145 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:27.208782 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:27.208790 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:27.208804 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:27.208845 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:27.211312 (+ 2467us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.73.131@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 14:57:27.211665 (+ 353us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55006: Request ticket server kudu/127.12.73.131@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":331,"threads_started":1}
W20260808 14:57:27.212086 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 27895: Not authorized: Client connection negotiation failed: client connection to 127.12.73.131:37891: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.73.131@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 14:57:27.212131 28183 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55006: Request ticket server kudu/127.12.73.131@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 14:57:27.212250 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 27895
I20260808 14:57:27.237890 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 27382
I20260808 14:57:27.239253 27479 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:27.359254 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 27382
2026-08-08T14:57:27Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22271 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T14:57:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:57:27Z Disabled control of system clock
I20260808 14:57:27.452492 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:41647
--webserver_interface=127.12.73.190
--webserver_port=0
--builtin_ntp_servers=127.12.73.148:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:41647
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 14:57:27.783243 28189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:27.783552 28189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:27.783705 28189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:27.790978 28189 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:57:27.791087 28189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:27.791181 28189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:27.791280 28189 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:57:27.791373 28189 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:57:27.800549 28189 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:41647
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:41647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:27.801936 28189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:27.803794 28189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:27.816293 28196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:27.816207 28198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:27.816246 28200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:27.817008 28189 server_base.cc:1034] running on GCE node
I20260808 14:57:27.817879 28189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:27.819254 28189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:27.820493 28189 hybrid_clock.cc:648] HybridClock initialized: now 1786201047820447 us; error 43 us; skew 500 ppm
I20260808 14:57:27.820850 28189 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:57:27.826085 28189 webserver.cc:460] Webserver started at http://127.12.73.190:36085/ using document root <none> and password file <none>
I20260808 14:57:27.826794 28189 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:27.826934 28189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:27.827273 28189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:27.830241 28189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "ace6747950ab445b9f531fcdfc5b8ba4"
format_stamp: "Formatted at 2026-08-08 14:57:27 on dist-test-slave-z8x9"
server_key: "165e0c23b241bd4f79a96d60f5b082fb"
server_key_iv: "8263d805c0ce125c4aa8737f3fcf7b8d"
server_key_version: "encryptionkey@0"
I20260808 14:57:27.831032 28189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "ace6747950ab445b9f531fcdfc5b8ba4"
format_stamp: "Formatted at 2026-08-08 14:57:27 on dist-test-slave-z8x9"
server_key: "165e0c23b241bd4f79a96d60f5b082fb"
server_key_iv: "8263d805c0ce125c4aa8737f3fcf7b8d"
server_key_version: "encryptionkey@0"
I20260808 14:57:27.836145 28189 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 14:57:27.839612 28210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:27.840845 28189 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:57:27.841037 28189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "ace6747950ab445b9f531fcdfc5b8ba4"
format_stamp: "Formatted at 2026-08-08 14:57:27 on dist-test-slave-z8x9"
server_key: "165e0c23b241bd4f79a96d60f5b082fb"
server_key_iv: "8263d805c0ce125c4aa8737f3fcf7b8d"
server_key_version: "encryptionkey@0"
I20260808 14:57:27.841281 28189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:27.883168 28189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:27.884095 28189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:27.884435 28189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:27.903497 28189 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:41647
I20260808 14:57:27.903517 28293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:41647 every 8 connection(s)
I20260808 14:57:27.904917 28189 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:57:27.906663 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 28189
I20260808 14:57:27.906872 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:57:27.907761 12582 external_mini_cluster.cc:1428] Setting key 3c742609986b97655383474adf9aa8d1
I20260808 14:57:27.910475 28294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:27.922693 28298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:27.909947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54226 (local address 127.12.73.190:41647)
0808 14:57:27.911493 (+ 1546us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:27.911512 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:27.911561 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:57:27.913516 (+ 1955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:27.913539 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:27.914063 (+ 524us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:27.914450 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:27.915230 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:27.916534 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:27.918453 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:27.919072 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:27.919194 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:27.920476 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:27.920483 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:27.920495 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:27.921039 (+ 544us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:27.921109 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:27.921129 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:27.921319 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:27.921517 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 14:57:27.921854 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1113,"thread_start_us":898,"threads_started":1}
I20260808 14:57:27.923612 28294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4: Bootstrap starting.
I20260808 14:57:27.926591 28294 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:27.927568 28294 log.cc:824] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:57:27.930373 28294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4: No bootstrap required, opened a new log
I20260808 14:57:27.937431 28294 raft_consensus.cc:348] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace6747950ab445b9f531fcdfc5b8ba4" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41647 } }
I20260808 14:57:27.937793 28294 raft_consensus.cc:374] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:27.937899 28294 raft_consensus.cc:729] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ace6747950ab445b9f531fcdfc5b8ba4, State: Initialized, Role: FOLLOWER
I20260808 14:57:27.938483 28294 consensus_queue.cc:260] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace6747950ab445b9f531fcdfc5b8ba4" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41647 } }
I20260808 14:57:27.938725 28294 raft_consensus.cc:388] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:57:27.938868 28294 raft_consensus.cc:482] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:57:27.939049 28294 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:27.941123 28294 raft_consensus.cc:504] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace6747950ab445b9f531fcdfc5b8ba4" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41647 } }
I20260808 14:57:27.941718 28294 leader_election.cc:302] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ace6747950ab445b9f531fcdfc5b8ba4; no voters:
I20260808 14:57:27.942291 28294 leader_election.cc:288] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:57:27.942437 28302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:57:27.943188 28302 raft_consensus.cc:686] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [term 1 LEADER]: Becoming Leader. State: Replica: ace6747950ab445b9f531fcdfc5b8ba4, State: Running, Role: LEADER
I20260808 14:57:27.943665 28302 consensus_queue.cc:237] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace6747950ab445b9f531fcdfc5b8ba4" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41647 } }
I20260808 14:57:27.944336 28294 sys_catalog.cc:564] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:57:27.946527 28304 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ace6747950ab445b9f531fcdfc5b8ba4. Latest consensus state: current_term: 1 leader_uuid: "ace6747950ab445b9f531fcdfc5b8ba4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace6747950ab445b9f531fcdfc5b8ba4" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41647 } } }
I20260808 14:57:27.946987 28304 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:57:27.947837 28303 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ace6747950ab445b9f531fcdfc5b8ba4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace6747950ab445b9f531fcdfc5b8ba4" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41647 } } }
I20260808 14:57:27.948197 28303 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:57:27.950469 28308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:57:27.957015 28308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:57:27.966012 28308 catalog_manager.cc:1347] Generated new cluster ID: 0cc25ed9114f46fd8b76d8d0547c837a
I20260808 14:57:27.966140 28308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:57:27.979620 28308 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:57:27.980870 28308 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:57:27.990065 28308 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ace6747950ab445b9f531fcdfc5b8ba4: Generated new TSK 0
I20260808 14:57:27.991014 28308 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:57:28.009646 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:41647
--builtin_ntp_servers=127.12.73.148:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 14:57:28.350258 28325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:28.350647 28325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:28.350814 28325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:28.358520 28325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:28.358660 28325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:28.358886 28325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:57:28.368096 28325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:41647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:28.369436 28325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:28.371215 28325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:28.383878 28332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:28.383982 28336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:28.383956 28333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:28.384939 28325 server_base.cc:1034] running on GCE node
I20260808 14:57:28.385630 28325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:28.386559 28325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:28.387924 28325 hybrid_clock.cc:648] HybridClock initialized: now 1786201048387861 us; error 44 us; skew 500 ppm
I20260808 14:57:28.388302 28325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:57:28.390542 28325 webserver.cc:460] Webserver started at http://127.12.73.129:35685/ using document root <none> and password file <none>
I20260808 14:57:28.391250 28325 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:28.391372 28325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:28.391777 28325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:28.394651 28325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "202d6c6fccbf49eba16b78b0217d0fd3"
format_stamp: "Formatted at 2026-08-08 14:57:28 on dist-test-slave-z8x9"
server_key: "59f2da9f37e303c19c69f370949670ec"
server_key_iv: "df0b4ef89d4e9028fe8802114b69de3f"
server_key_version: "encryptionkey@0"
I20260808 14:57:28.395509 28325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "202d6c6fccbf49eba16b78b0217d0fd3"
format_stamp: "Formatted at 2026-08-08 14:57:28 on dist-test-slave-z8x9"
server_key: "59f2da9f37e303c19c69f370949670ec"
server_key_iv: "df0b4ef89d4e9028fe8802114b69de3f"
server_key_version: "encryptionkey@0"
I20260808 14:57:28.400687 28325 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:57:28.404206 28346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:28.405500 28325 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:57:28.405665 28325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "202d6c6fccbf49eba16b78b0217d0fd3"
format_stamp: "Formatted at 2026-08-08 14:57:28 on dist-test-slave-z8x9"
server_key: "59f2da9f37e303c19c69f370949670ec"
server_key_iv: "df0b4ef89d4e9028fe8802114b69de3f"
server_key_version: "encryptionkey@0"
I20260808 14:57:28.405881 28325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:28.432806 28325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:28.433661 28325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:28.434151 28325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:28.435176 28325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:28.436635 28325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:28.436759 28325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:28.436893 28325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:28.437004 28325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:28.471238 28325 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:43165
I20260808 14:57:28.471349 28519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:43165 every 8 connection(s)
I20260808 14:57:28.472597 28325 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:57:28.479961 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 28325
I20260808 14:57:28.480162 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:57:28.481001 12582 external_mini_cluster.cc:1428] Setting key 73d8f0b51dc929ebb643d95abebc5ac6
I20260808 14:57:28.483700 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:41647
--builtin_ntp_servers=127.12.73.148:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 14:57:28.485641 28524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:28.475265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:33909 (local address 127.12.73.190:41647)
0808 14:57:28.475719 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:28.475725 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:28.476903 (+ 1178us) server_negotiation.cc:407] Connection header received
0808 14:57:28.478655 (+ 1752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:28.478659 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:28.478724 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:28.478842 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:28.479891 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:28.481063 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:28.482828 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:28.483242 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:28.483378 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:28.484768 (+ 1390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:28.484773 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:28.484776 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:28.484793 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:28.484831 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:28.484849 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:28.484943 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:28.485203 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 14:57:28.485299 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":212,"threads_started":1}
I20260808 14:57:28.486583 28525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:28.475899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:41647 (local address 127.12.73.129:33909)
0808 14:57:28.476751 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:28.476786 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:28.478416 (+ 1630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:28.479034 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:28.479041 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:28.479144 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:28.479698 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:28.479715 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:28.481252 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:28.481255 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:28.482675 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:28.482690 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:28.483479 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:28.483486 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:28.483710 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:28.484459 (+ 749us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:57:28.484462 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:28.484498 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:57:28.484571 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:28.484944 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:28.484958 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:28.484968 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:57:28.485163 (+ 195us) client_negotiation.cc:240] Negotiation successful
0808 14:57:28.485554 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":266,"threads_started":1}
I20260808 14:57:28.488062 28520 heartbeater.cc:347] Connected to a master server at 127.12.73.190:41647
I20260808 14:57:28.488353 28520 heartbeater.cc:464] Registering TS with master...
I20260808 14:57:28.489048 28520 heartbeater.cc:511] Master 127.12.73.190:41647 requested a full tablet report, sending...
I20260808 14:57:28.491322 28234 ts_manager.cc:194] Registered new tserver with Master: 202d6c6fccbf49eba16b78b0217d0fd3 (127.12.73.129:43165)
I20260808 14:57:28.493462 28234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.73.129:33909
W20260808 14:57:28.821421 28527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:28.821671 28527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:28.821759 28527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:28.828665 28527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:28.828765 28527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:28.828950 28527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:57:28.839390 28527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:41647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:28.840653 28527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:28.842473 28527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:28.855643 28540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:28.855597 28544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:28.855680 28541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:28.856796 28527 server_base.cc:1034] running on GCE node
I20260808 14:57:28.857492 28527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:28.858389 28527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:28.859620 28527 hybrid_clock.cc:648] HybridClock initialized: now 1786201048859560 us; error 50 us; skew 500 ppm
I20260808 14:57:28.859998 28527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:57:28.862304 28527 webserver.cc:460] Webserver started at http://127.12.73.130:45111/ using document root <none> and password file <none>
I20260808 14:57:28.863000 28527 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:28.863137 28527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:28.863471 28527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:28.866285 28527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "580187d7cbba4129bed2c8ddf0bb0e22"
format_stamp: "Formatted at 2026-08-08 14:57:28 on dist-test-slave-z8x9"
server_key: "2e1b1db804f450679eb39144ccbdedff"
server_key_iv: "7c5ca5d1b8b98ee6d6c9401a4fc99a51"
server_key_version: "encryptionkey@0"
I20260808 14:57:28.867098 28527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "580187d7cbba4129bed2c8ddf0bb0e22"
format_stamp: "Formatted at 2026-08-08 14:57:28 on dist-test-slave-z8x9"
server_key: "2e1b1db804f450679eb39144ccbdedff"
server_key_iv: "7c5ca5d1b8b98ee6d6c9401a4fc99a51"
server_key_version: "encryptionkey@0"
I20260808 14:57:28.872421 28527 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 14:57:28.875890 28553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:28.877087 28527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:57:28.877315 28527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "580187d7cbba4129bed2c8ddf0bb0e22"
format_stamp: "Formatted at 2026-08-08 14:57:28 on dist-test-slave-z8x9"
server_key: "2e1b1db804f450679eb39144ccbdedff"
server_key_iv: "7c5ca5d1b8b98ee6d6c9401a4fc99a51"
server_key_version: "encryptionkey@0"
I20260808 14:57:28.877534 28527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:28.889042 28527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:28.889863 28527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:28.890177 28527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:28.891213 28527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:28.892678 28527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:28.892803 28527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:28.892935 28527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:28.893031 28527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:28.931656 28527 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:34753
I20260808 14:57:28.931713 28739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:34753 every 8 connection(s)
I20260808 14:57:28.933072 28527 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:57:28.942996 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 28527
I20260808 14:57:28.943234 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:57:28.943698 12582 external_mini_cluster.cc:1428] Setting key 043137922ede7a4db499bb6ee697c7d5
I20260808 14:57:28.946638 28524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:28.935956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:41633 (local address 127.12.73.190:41647)
0808 14:57:28.936160 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:28.936164 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:28.937619 (+ 1455us) server_negotiation.cc:407] Connection header received
0808 14:57:28.939416 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:28.939422 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:28.939511 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:28.939625 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:28.940697 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:28.941517 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:28.943065 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:28.943570 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:28.943709 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:28.945788 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:28.945795 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:28.945799 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:28.945820 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:28.945861 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:28.945876 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:28.945966 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:28.946298 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 14:57:28.946394 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:57:28.947021 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:41647
--builtin_ntp_servers=127.12.73.148:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 14:57:28.948079 28742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:28.936462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:41647 (local address 127.12.73.130:41633)
0808 14:57:28.937453 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:28.937490 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:28.939147 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:28.939854 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:28.939861 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:28.939948 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:28.940518 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:28.940534 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:28.941691 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:28.941695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:28.942919 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:28.942932 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:28.943814 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:28.943822 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:28.944045 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:28.945411 (+ 1366us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:57:28.945415 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:28.945472 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:57:28.945574 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:28.946005 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:28.946017 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:28.946026 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 14:57:28.946228 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 14:57:28.946670 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":285,"threads_started":1}
I20260808 14:57:28.949543 28740 heartbeater.cc:347] Connected to a master server at 127.12.73.190:41647
I20260808 14:57:28.949862 28740 heartbeater.cc:464] Registering TS with master...
I20260808 14:57:28.950701 28740 heartbeater.cc:511] Master 127.12.73.190:41647 requested a full tablet report, sending...
I20260808 14:57:28.952217 28234 ts_manager.cc:194] Registered new tserver with Master: 580187d7cbba4129bed2c8ddf0bb0e22 (127.12.73.130:34753)
I20260808 14:57:28.953089 28234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.73.130:41633
W20260808 14:57:29.283768 28743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:29.284080 28743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:29.284251 28743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:29.291358 28743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:29.291497 28743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:29.291679 28743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:57:29.301918 28743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:41647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:29.303275 28743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:29.305056 28743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:29.318121 28758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:29.318215 28756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:29.318215 28755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:29.319214 28743 server_base.cc:1034] running on GCE node
I20260808 14:57:29.319810 28743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:29.320705 28743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:29.321928 28743 hybrid_clock.cc:648] HybridClock initialized: now 1786201049321886 us; error 52 us; skew 500 ppm
I20260808 14:57:29.322239 28743 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:57:29.324405 28743 webserver.cc:460] Webserver started at http://127.12.73.131:35541/ using document root <none> and password file <none>
I20260808 14:57:29.325088 28743 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:29.325238 28743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:29.325574 28743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:29.328325 28743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "52428e15a3ed4d10b896fe791c294307"
format_stamp: "Formatted at 2026-08-08 14:57:29 on dist-test-slave-z8x9"
server_key: "064307b16ad07f040a6a206f14bd4720"
server_key_iv: "120f3b58b8163bfc115d0d9c491ddb3a"
server_key_version: "encryptionkey@0"
I20260808 14:57:29.329115 28743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "52428e15a3ed4d10b896fe791c294307"
format_stamp: "Formatted at 2026-08-08 14:57:29 on dist-test-slave-z8x9"
server_key: "064307b16ad07f040a6a206f14bd4720"
server_key_iv: "120f3b58b8163bfc115d0d9c491ddb3a"
server_key_version: "encryptionkey@0"
I20260808 14:57:29.334164 28743 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 14:57:29.337509 28768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:29.338690 28743 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:57:29.338874 28743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "52428e15a3ed4d10b896fe791c294307"
format_stamp: "Formatted at 2026-08-08 14:57:29 on dist-test-slave-z8x9"
server_key: "064307b16ad07f040a6a206f14bd4720"
server_key_iv: "120f3b58b8163bfc115d0d9c491ddb3a"
server_key_version: "encryptionkey@0"
I20260808 14:57:29.339092 28743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:29.353317 28743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:29.354153 28743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:29.354457 28743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:29.355435 28743 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:29.356880 28743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:29.357004 28743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:29.357153 28743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:29.357273 28743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260808 14:57:29.391466 28743 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:38565
I20260808 14:57:29.391558 28950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:38565 every 8 connection(s)
I20260808 14:57:29.393038 28743 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:57:29.397523 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 28743
I20260808 14:57:29.397704 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:57:29.398288 12582 external_mini_cluster.cc:1428] Setting key 2c692d9b40fa552e20400a453e976d0a
I20260808 14:57:29.406242 28524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:29.395876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:39417 (local address 127.12.73.190:41647)
0808 14:57:29.396100 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:29.396106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:29.397667 (+ 1561us) server_negotiation.cc:407] Connection header received
0808 14:57:29.400071 (+ 2404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:29.400078 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:29.400165 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:29.400275 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:29.401541 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:29.402273 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:29.403745 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:29.404154 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:29.404253 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:29.405535 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:29.405540 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:29.405543 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:29.405560 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:29.405592 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:29.405603 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:29.405674 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:29.405919 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 14:57:29.405998 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:57:29.407104 28954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:29.396418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:41647 (local address 127.12.73.131:39417)
0808 14:57:29.397476 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:29.397536 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:29.399738 (+ 2202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:29.400531 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:29.400539 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:29.400618 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:29.401361 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:29.401389 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:29.402401 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:29.402405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:29.403604 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:29.403615 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:29.404348 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:29.404353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:29.404540 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:29.405230 (+ 690us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:57:29.405234 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:29.405285 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:57:29.405366 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:29.405687 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:29.405695 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:29.405700 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:57:29.405834 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 14:57:29.406095 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":283,"threads_started":1}
I20260808 14:57:29.408334 28952 heartbeater.cc:347] Connected to a master server at 127.12.73.190:41647
I20260808 14:57:29.408632 28952 heartbeater.cc:464] Registering TS with master...
I20260808 14:57:29.409520 28952 heartbeater.cc:511] Master 127.12.73.190:41647 requested a full tablet report, sending...
I20260808 14:57:29.410907 28234 ts_manager.cc:194] Registered new tserver with Master: 52428e15a3ed4d10b896fe791c294307 (127.12.73.131:38565)
I20260808 14:57:29.411664 28234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.73.131:39417
I20260808 14:57:29.413777 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:57:29.419907 28524 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:29.418444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54238 (local address 127.12.73.190:41647)
0808 14:57:29.418697 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:29.418704 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:29.419075 (+ 371us) server_negotiation.cc:407] Connection header received
0808 14:57:29.419219 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:29.419223 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:29.419293 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:29.419373 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:29.419681 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54238: BlockingRecv error: recv got EOF from 127.0.0.1:54238 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:57:29.420414 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 28325
I20260808 14:57:29.427728 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:29.421351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53910 (local address 127.12.73.129:43165)
0808 14:57:29.421849 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:29.421855 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:29.421879 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:57:29.421931 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:29.421937 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:29.422111 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:29.422229 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:29.422560 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:29.423515 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:29.424777 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:29.425370 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:29.425467 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:29.426485 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:29.426492 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:29.426503 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:29.427056 (+ 553us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:29.427105 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:29.427123 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:29.427209 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:29.427351 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:57:29.427449 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":256,"threads_started":1}
I20260808 14:57:29.428900 28515 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:29.510737 28520 heartbeater.cc:503] Master 127.12.73.190:41647 was elected leader, sending a full tablet report...
I20260808 14:57:29.512557 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 28325
W20260808 14:57:29.536973 28214 connection.cc:535] server connection from 127.12.73.129:33909 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:57:29.537401 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 28527
I20260808 14:57:29.545648 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:29.538338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53052 (local address 127.12.73.130:34753)
0808 14:57:29.538883 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:29.538890 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:29.538917 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:57:29.538984 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:29.538991 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:29.539204 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:29.539394 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:29.539802 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:29.540825 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:29.542198 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:29.542773 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:29.542918 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:29.544028 (+ 1110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:29.544036 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:29.544049 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:29.544687 (+ 638us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:29.544734 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:29.544754 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:29.544894 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:29.545044 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 14:57:29.545225 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":285,"threads_started":1}
I20260808 14:57:29.547019 28734 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:29.629017 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 28527
I20260808 14:57:29.654321 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 28743
I20260808 14:57:29.663038 28967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:29.655389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37962 (local address 127.12.73.131:38565)
0808 14:57:29.656092 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:29.656098 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:29.656129 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:57:29.656194 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:29.656201 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:29.656432 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:29.656627 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:29.656991 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:29.658264 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:29.659655 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:29.660282 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:29.660399 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:29.661555 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:29.661585 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:29.661603 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:29.662202 (+ 599us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:29.662247 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:29.662272 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:29.662370 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:29.662508 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 14:57:29.662675 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":389,"threads_started":1}
I20260808 14:57:29.664341 28945 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:29.745594 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 28743
I20260808 14:57:29.773438 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 28189
I20260808 14:57:29.774598 28286 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:29.878235 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 28189
2026-08-08T14:57:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2513 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T14:57:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:57:29Z Disabled control of system clock
I20260808 14:57:29.968447 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:39909
--webserver_interface=127.12.73.190
--webserver_port=0
--builtin_ntp_servers=127.12.73.148:40655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:39909
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:57:30.307283 28978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:30.307564 28978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:30.307649 28978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:30.314776 28978 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:57:30.314886 28978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:30.314925 28978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:30.314987 28978 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:57:30.315032 28978 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:57:30.324049 28978 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:39909
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:39909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:30.325289 28978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:30.327080 28978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:30.338886 28988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:30.338915 28991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:30.339000 28987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:30.339627 28978 server_base.cc:1034] running on GCE node
I20260808 14:57:30.340408 28978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:30.341862 28978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:30.343103 28978 hybrid_clock.cc:648] HybridClock initialized: now 1786201050343065 us; error 48 us; skew 500 ppm
I20260808 14:57:30.343513 28978 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:57:30.345880 28978 webserver.cc:460] Webserver started at http://127.12.73.190:39019/ using document root <none> and password file <none>
I20260808 14:57:30.346581 28978 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:30.346721 28978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:30.347059 28978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:30.349932 28978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "4872799f04b24405be9ddd113bee1713"
format_stamp: "Formatted at 2026-08-08 14:57:30 on dist-test-slave-z8x9"
server_key: "ef5875539b0bc53129bcc615a0977842"
server_key_iv: "301a93b31c2b0275231a077a57d7d207"
server_key_version: "encryptionkey@0"
I20260808 14:57:30.350736 28978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "4872799f04b24405be9ddd113bee1713"
format_stamp: "Formatted at 2026-08-08 14:57:30 on dist-test-slave-z8x9"
server_key: "ef5875539b0bc53129bcc615a0977842"
server_key_iv: "301a93b31c2b0275231a077a57d7d207"
server_key_version: "encryptionkey@0"
I20260808 14:57:30.355719 28978 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:57:30.358999 29002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:30.360193 28978 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:57:30.360378 28978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "4872799f04b24405be9ddd113bee1713"
format_stamp: "Formatted at 2026-08-08 14:57:30 on dist-test-slave-z8x9"
server_key: "ef5875539b0bc53129bcc615a0977842"
server_key_iv: "301a93b31c2b0275231a077a57d7d207"
server_key_version: "encryptionkey@0"
I20260808 14:57:30.360599 28978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:30.366261 28978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:30.366978 28978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:30.367264 28978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:30.384639 28978 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:39909
I20260808 14:57:30.384672 29087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:39909 every 8 connection(s)
I20260808 14:57:30.385933 28978 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:57:30.389586 29088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:30.394552 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 28978
I20260808 14:57:30.394779 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:57:30.395401 12582 external_mini_cluster.cc:1428] Setting key c5725f79b121ef1b0396ec3f8abd5268
I20260808 14:57:30.399919 29088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713: Bootstrap starting.
I20260808 14:57:30.403388 29088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:30.403474 29093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:30.397446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53034 (local address 127.12.73.190:39909)
0808 14:57:30.398434 (+ 988us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:30.398444 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:30.398481 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:57:30.400135 (+ 1654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:30.400158 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:30.400515 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:30.400809 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:30.401984 (+ 1175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:30.401991 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:30.402006 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:30.402019 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:30.402075 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:30.402094 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:30.402247 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:30.402382 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 14:57:30.402637 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":390,"threads_started":1}
I20260808 14:57:30.404757 29088 log.cc:824] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713: Log is configured to *not* fsync() on all Append() calls
I20260808 14:57:30.407660 29088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713: No bootstrap required, opened a new log
I20260808 14:57:30.414687 29088 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4872799f04b24405be9ddd113bee1713" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 39909 } }
I20260808 14:57:30.415027 29088 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:30.415133 29088 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4872799f04b24405be9ddd113bee1713, State: Initialized, Role: FOLLOWER
I20260808 14:57:30.415751 29088 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4872799f04b24405be9ddd113bee1713" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 39909 } }
I20260808 14:57:30.416036 29088 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:57:30.416177 29088 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:57:30.416368 29088 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:30.418565 29088 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4872799f04b24405be9ddd113bee1713" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 39909 } }
I20260808 14:57:30.419045 29088 leader_election.cc:302] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4872799f04b24405be9ddd113bee1713; no voters:
I20260808 14:57:30.419606 29088 leader_election.cc:288] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:57:30.419736 29095 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:57:30.420841 29095 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [term 1 LEADER]: Becoming Leader. State: Replica: 4872799f04b24405be9ddd113bee1713, State: Running, Role: LEADER
I20260808 14:57:30.421478 29095 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4872799f04b24405be9ddd113bee1713" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 39909 } }
I20260808 14:57:30.421770 29088 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:57:30.425079 29096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4872799f04b24405be9ddd113bee1713" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4872799f04b24405be9ddd113bee1713" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 39909 } } }
I20260808 14:57:30.425604 29096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [sys.catalog]: This master's current role is: LEADER
I20260808 14:57:30.424495 29097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4872799f04b24405be9ddd113bee1713. Latest consensus state: current_term: 1 leader_uuid: "4872799f04b24405be9ddd113bee1713" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4872799f04b24405be9ddd113bee1713" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 39909 } } }
I20260808 14:57:30.426254 29097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713 [sys.catalog]: This master's current role is: LEADER
I20260808 14:57:30.427089 29105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:57:30.432291 29105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:57:30.440981 29105 catalog_manager.cc:1347] Generated new cluster ID: 37a4597f8c434546b9434c8d9dd7f988
I20260808 14:57:30.441098 29105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:57:30.462155 29105 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:57:30.462584 29105 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:57:30.472430 29105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4872799f04b24405be9ddd113bee1713: Generated new TSK 0
I20260808 14:57:30.473331 29105 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:57:30.484869 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:39909
--builtin_ntp_servers=127.12.73.148:40655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:57:30.825105 29118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:30.825464 29118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:30.825614 29118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:30.833097 29118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:30.833257 29118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:30.833426 29118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:57:30.842366 29118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:39909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:30.843618 29118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:30.845520 29118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:30.858525 29127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:30.858631 29134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:30.858634 29130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:30.859434 29118 server_base.cc:1034] running on GCE node
I20260808 14:57:30.860035 29118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:30.860961 29118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:30.862169 29118 hybrid_clock.cc:648] HybridClock initialized: now 1786201050862110 us; error 44 us; skew 500 ppm
I20260808 14:57:30.862493 29118 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:57:30.864899 29118 webserver.cc:460] Webserver started at http://127.12.73.129:32961/ using document root <none> and password file <none>
I20260808 14:57:30.865633 29118 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:30.865772 29118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:30.866117 29118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:30.868980 29118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "e4f4ebd232cc41dfb318885a43651da3"
format_stamp: "Formatted at 2026-08-08 14:57:30 on dist-test-slave-z8x9"
server_key: "fea27e898467e9fa0a777520dd520630"
server_key_iv: "353850835a7bb66cb7ea8e62c7d14885"
server_key_version: "encryptionkey@0"
I20260808 14:57:30.869923 29118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "e4f4ebd232cc41dfb318885a43651da3"
format_stamp: "Formatted at 2026-08-08 14:57:30 on dist-test-slave-z8x9"
server_key: "fea27e898467e9fa0a777520dd520630"
server_key_iv: "353850835a7bb66cb7ea8e62c7d14885"
server_key_version: "encryptionkey@0"
I20260808 14:57:30.875006 29118 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 14:57:30.878294 29142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:30.879535 29118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:57:30.879702 29118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "e4f4ebd232cc41dfb318885a43651da3"
format_stamp: "Formatted at 2026-08-08 14:57:30 on dist-test-slave-z8x9"
server_key: "fea27e898467e9fa0a777520dd520630"
server_key_iv: "353850835a7bb66cb7ea8e62c7d14885"
server_key_version: "encryptionkey@0"
I20260808 14:57:30.879921 29118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:30.885442 29118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:30.886188 29118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:30.886469 29118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:30.887342 29118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:30.889242 29118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:30.889371 29118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 14:57:30.889482 29118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:30.889561 29118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:30.923111 29118 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:36823
I20260808 14:57:30.923167 29304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:36823 every 8 connection(s)
I20260808 14:57:30.924415 29118 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:57:30.932739 29307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:30.927154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:46595 (local address 127.12.73.190:39909)
0808 14:57:30.927644 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:30.927648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:30.928765 (+ 1117us) server_negotiation.cc:407] Connection header received
0808 14:57:30.930520 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:30.930525 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:30.930597 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:30.930724 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:30.931958 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:30.931964 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:30.931969 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:30.931989 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:30.932040 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:30.932053 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:30.932190 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:30.932389 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 14:57:30.932458 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":265,"threads_started":1}
I20260808 14:57:30.933707 29308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:30.927616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:39909 (local address 127.12.73.129:46595)
0808 14:57:30.928618 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:30.928652 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:30.930245 (+ 1593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:30.930962 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:30.930969 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:30.931053 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:30.931669 (+ 616us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:57:30.931672 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:30.931708 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:57:30.931786 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:30.932155 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:30.932169 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:30.932177 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:57:30.932472 (+ 295us) client_negotiation.cc:240] Negotiation successful
0808 14:57:30.932699 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":330,"threads_started":1}
I20260808 14:57:30.934422 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 29118
I20260808 14:57:30.934666 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:57:30.935456 29305 heartbeater.cc:347] Connected to a master server at 127.12.73.190:39909
I20260808 14:57:30.935504 12582 external_mini_cluster.cc:1428] Setting key d48854a3ae4dc3d0205d5f0af7782c1a
I20260808 14:57:30.935770 29305 heartbeater.cc:464] Registering TS with master...
I20260808 14:57:30.936499 29305 heartbeater.cc:511] Master 127.12.73.190:39909 requested a full tablet report, sending...
I20260808 14:57:30.938575 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:39909
--builtin_ntp_servers=127.12.73.148:40655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 14:57:30.938809 29027 ts_manager.cc:194] Registered new tserver with Master: e4f4ebd232cc41dfb318885a43651da3 (127.12.73.129:36823)
W20260808 14:57:31.272671 29309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:31.272975 29309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:31.273155 29309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:31.282912 29309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:31.283098 29309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:31.283316 29309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:57:31.299727 29309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:39909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:31.301853 29309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:31.304399 29309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:31.320135 29318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:31.320160 29316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:31.321578 29321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:31.322275 29309 server_base.cc:1034] running on GCE node
I20260808 14:57:31.323072 29309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:31.324468 29309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:31.325700 29309 hybrid_clock.cc:648] HybridClock initialized: now 1786201051325636 us; error 50 us; skew 500 ppm
I20260808 14:57:31.326133 29309 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:57:31.329160 29309 webserver.cc:460] Webserver started at http://127.12.73.130:45897/ using document root <none> and password file <none>
I20260808 14:57:31.330000 29309 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:31.330139 29309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:31.330494 29309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:31.333484 29309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "d3659460ce8141d5b8c9b0807d50c1c7"
format_stamp: "Formatted at 2026-08-08 14:57:31 on dist-test-slave-z8x9"
server_key: "b69036661f761ff999894b4db49d64f8"
server_key_iv: "50bf3aa86a11172d8c9472f85a7e68b9"
server_key_version: "encryptionkey@0"
I20260808 14:57:31.334522 29309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "d3659460ce8141d5b8c9b0807d50c1c7"
format_stamp: "Formatted at 2026-08-08 14:57:31 on dist-test-slave-z8x9"
server_key: "b69036661f761ff999894b4db49d64f8"
server_key_iv: "50bf3aa86a11172d8c9472f85a7e68b9"
server_key_version: "encryptionkey@0"
I20260808 14:57:31.340142 29309 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:57:31.343741 29328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:31.345021 29309 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 14:57:31.345289 29309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "d3659460ce8141d5b8c9b0807d50c1c7"
format_stamp: "Formatted at 2026-08-08 14:57:31 on dist-test-slave-z8x9"
server_key: "b69036661f761ff999894b4db49d64f8"
server_key_iv: "50bf3aa86a11172d8c9472f85a7e68b9"
server_key_version: "encryptionkey@0"
I20260808 14:57:31.345533 29309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:31.351536 29309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:31.352362 29309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:31.352648 29309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:31.353652 29309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:31.355086 29309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:31.355229 29309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:31.355361 29309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:31.355455 29309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:31.391160 29309 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:40877
I20260808 14:57:31.391197 29504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:40877 every 8 connection(s)
I20260808 14:57:31.392519 29309 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:57:31.397426 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 29309
I20260808 14:57:31.397621 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:57:31.398180 12582 external_mini_cluster.cc:1428] Setting key 9cba1c4c355c35d3b3a361679eb74ed2
I20260808 14:57:31.401139 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:39909
--builtin_ntp_servers=127.12.73.148:40655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 14:57:31.401620 29307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:31.395333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:44719 (local address 127.12.73.190:39909)
0808 14:57:31.395563 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:31.395570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:31.397071 (+ 1501us) server_negotiation.cc:407] Connection header received
0808 14:57:31.399133 (+ 2062us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:31.399138 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:31.399223 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:31.399336 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:31.400799 (+ 1463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:31.400805 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:31.400810 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:31.400828 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:31.400870 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:31.400882 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:31.401028 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:31.401242 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 14:57:31.401311 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 14:57:31.402715 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:31.395799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:39909 (local address 127.12.73.130:44719)
0808 14:57:31.396867 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:31.396912 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:31.398830 (+ 1918us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:31.399569 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:31.399577 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:31.399671 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:31.400497 (+ 826us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:57:31.400500 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:31.400539 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:57:31.400625 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:31.400982 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:31.400996 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:31.401007 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 14:57:31.401351 (+ 344us) client_negotiation.cc:240] Negotiation successful
0808 14:57:31.401604 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":350,"threads_started":1}
I20260808 14:57:31.404148 29505 heartbeater.cc:347] Connected to a master server at 127.12.73.190:39909
I20260808 14:57:31.404453 29505 heartbeater.cc:464] Registering TS with master...
I20260808 14:57:31.405045 29505 heartbeater.cc:511] Master 127.12.73.190:39909 requested a full tablet report, sending...
I20260808 14:57:31.406503 29027 ts_manager.cc:194] Registered new tserver with Master: d3659460ce8141d5b8c9b0807d50c1c7 (127.12.73.130:40877)
W20260808 14:57:31.738690 29509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:31.739017 29509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:31.739197 29509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:31.746409 29509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:31.746562 29509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:31.746776 29509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:57:31.756242 29509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:40655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:39909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:31.757612 29509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:31.759423 29509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:31.772789 29515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:31.772887 29516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:31.772810 29518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:31.773747 29509 server_base.cc:1034] running on GCE node
I20260808 14:57:31.774336 29509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:31.775220 29509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:31.776454 29509 hybrid_clock.cc:648] HybridClock initialized: now 1786201051776407 us; error 59 us; skew 500 ppm
I20260808 14:57:31.776777 29509 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:57:31.779206 29509 webserver.cc:460] Webserver started at http://127.12.73.131:42057/ using document root <none> and password file <none>
I20260808 14:57:31.779934 29509 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:31.780073 29509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:31.780403 29509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:31.783205 29509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "20c7a3457b854fb8ad973c5a09021c34"
format_stamp: "Formatted at 2026-08-08 14:57:31 on dist-test-slave-z8x9"
server_key: "e944038a00b705300316ebf940ea6987"
server_key_iv: "906a227470b461c6cab6ae0b10128b99"
server_key_version: "encryptionkey@0"
I20260808 14:57:31.784053 29509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "20c7a3457b854fb8ad973c5a09021c34"
format_stamp: "Formatted at 2026-08-08 14:57:31 on dist-test-slave-z8x9"
server_key: "e944038a00b705300316ebf940ea6987"
server_key_iv: "906a227470b461c6cab6ae0b10128b99"
server_key_version: "encryptionkey@0"
I20260808 14:57:31.789073 29509 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 14:57:31.792423 29525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:31.793764 29509 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:57:31.793943 29509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "20c7a3457b854fb8ad973c5a09021c34"
format_stamp: "Formatted at 2026-08-08 14:57:31 on dist-test-slave-z8x9"
server_key: "e944038a00b705300316ebf940ea6987"
server_key_iv: "906a227470b461c6cab6ae0b10128b99"
server_key_version: "encryptionkey@0"
I20260808 14:57:31.794162 29509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:31.799810 29509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:31.800587 29509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:31.800866 29509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:31.801863 29509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:31.803244 29509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:31.803365 29509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:31.803503 29509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:31.803609 29509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:31.837751 29509 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:41389
I20260808 14:57:31.837838 29700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:41389 every 8 connection(s)
I20260808 14:57:31.839048 29509 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:57:31.840863 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 29509
I20260808 14:57:31.841063 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:57:31.841595 12582 external_mini_cluster.cc:1428] Setting key c36e29a02a9d2f1a293cc1d36ac043ad
I20260808 14:57:31.848143 29307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:31.842015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:58213 (local address 127.12.73.190:39909)
0808 14:57:31.842276 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:31.842284 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:31.843960 (+ 1676us) server_negotiation.cc:407] Connection header received
0808 14:57:31.845915 (+ 1955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:31.845921 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:31.845992 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:31.846108 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:31.847389 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:31.847395 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:31.847400 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:31.847419 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:31.847462 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:31.847474 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:31.847598 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:31.847794 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 14:57:31.847862 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 14:57:31.849023 29705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:31.842613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:39909 (local address 127.12.73.131:58213)
0808 14:57:31.843791 (+ 1178us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:31.843854 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:31.845660 (+ 1806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:31.846345 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:31.846352 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:31.846446 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:31.847067 (+ 621us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:57:31.847069 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:31.847106 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:57:31.847222 (+ 116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:31.847571 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:31.847583 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:31.847591 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:57:31.847884 (+ 293us) client_negotiation.cc:240] Negotiation successful
0808 14:57:31.848127 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":361,"threads_started":1}
I20260808 14:57:31.850545 29701 heartbeater.cc:347] Connected to a master server at 127.12.73.190:39909
I20260808 14:57:31.850844 29701 heartbeater.cc:464] Registering TS with master...
I20260808 14:57:31.851442 29701 heartbeater.cc:511] Master 127.12.73.190:39909 requested a full tablet report, sending...
I20260808 14:57:31.852759 29027 ts_manager.cc:194] Registered new tserver with Master: 20c7a3457b854fb8ad973c5a09021c34 (127.12.73.131:41389)
I20260808 14:57:31.856941 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:57:31.862603 29307 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:57:31.861277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53046 (local address 127.12.73.190:39909)
0808 14:57:31.861432 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:31.861436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:31.861914 (+ 478us) server_negotiation.cc:407] Connection header received
0808 14:57:31.862041 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:31.862044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:31.862095 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:31.862170 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:31.862429 (+ 259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53046: BlockingRecv error: recv got EOF from 127.0.0.1:53046 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:57:31.863245 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 29118
I20260808 14:57:31.867045 29717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:31.864325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44772 (local address 127.12.73.129:36823)
0808 14:57:31.864871 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:31.864878 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:31.864901 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:57:31.864957 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:31.864962 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:31.865140 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:31.865362 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:31.866343 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:31.866349 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:31.866359 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:31.866378 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:31.866416 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:31.866430 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:31.866573 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:31.866677 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 14:57:31.866790 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":260,"threads_started":1}
I20260808 14:57:31.868238 29300 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:31.950735 29305 heartbeater.cc:503] Master 127.12.73.190:39909 was elected leader, sending a full tablet report...
I20260808 14:57:31.952553 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 29118
I20260808 14:57:31.977659 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 29309
I20260808 14:57:31.981436 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:31.978621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39978 (local address 127.12.73.130:40877)
0808 14:57:31.979137 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:31.979152 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:31.979177 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:57:31.979248 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:31.979254 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:31.979483 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:31.979667 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:31.980697 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:31.980703 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:31.980715 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:31.980726 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:31.980766 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:31.980779 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:31.980944 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:31.981028 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 14:57:31.981129 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":254,"threads_started":1}
I20260808 14:57:31.982630 29499 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:32.064332 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 29309
I20260808 14:57:32.089156 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 29509
I20260808 14:57:32.093487 29722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:32.090288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52778 (local address 127.12.73.131:41389)
0808 14:57:32.090937 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:32.090943 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:32.090973 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:57:32.091039 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:32.091045 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:32.091275 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:32.091449 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:32.092644 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:32.092650 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:32.092661 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:57:32.092678 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:32.092717 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:57:32.092731 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:32.092927 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:32.093007 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 14:57:32.093111 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":332,"threads_started":1}
I20260808 14:57:32.094779 29694 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:32.177018 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 29509
I20260808 14:57:32.199287 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 28978
I20260808 14:57:32.200466 29083 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:32.304863 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 28978
2026-08-08T14:57:32Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2429 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:57:32 dist-test-slave-z8x9 krb5kdc[29729](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:57:32 dist-test-slave-z8x9 krb5kdc[29729](info): set up 2 sockets
Aug 08 14:57:32 dist-test-slave-z8x9 krb5kdc[29729](info): commencing operation
krb5kdc: starting...
W20260808 14:57:33.668568 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.001s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:57:33 dist-test-slave-z8x9 krb5kdc[29729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:57:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:57:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:57:33.947151 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36193
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:35441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:36193
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:57:34.277693 29752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:34.277987 29752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:34.278164 29752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:34.285243 29752 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:57:34.285344 29752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:34.285450 29752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:34.285552 29752 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:57:34.285635 29752 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:57:34.295212 29752 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:36193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:34.296571 29752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:34.297958 29752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:34.310000 29762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:34.309964 29765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:34.310505 29767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:34.311164 29752 server_base.cc:1034] running on GCE node
I20260808 14:57:34.311934 29752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:34.313385 29752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:34.314600 29752 hybrid_clock.cc:648] HybridClock initialized: now 1786201054314558 us; error 31 us; skew 500 ppm
I20260808 14:57:34.314989 29752 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:57:34 dist-test-slave-z8x9 krb5kdc[29729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201054, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:57:34.323316 29752 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:57:34.324949 29752 webserver.cc:460] Webserver started at http://127.12.73.190:43965/ using document root <none> and password file <none>
I20260808 14:57:34.325778 29752 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:34.325941 29752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:34.326260 29752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:34.329329 29752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "a193a671ff144bc7838847c6d587a98d"
format_stamp: "Formatted at 2026-08-08 14:57:34 on dist-test-slave-z8x9"
server_key: "51ea43f74dafae5eb497b948a8aa6723"
server_key_iv: "60920f38717d44712135ae9de3119b05"
server_key_version: "encryptionkey@0"
I20260808 14:57:34.330122 29752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "a193a671ff144bc7838847c6d587a98d"
format_stamp: "Formatted at 2026-08-08 14:57:34 on dist-test-slave-z8x9"
server_key: "51ea43f74dafae5eb497b948a8aa6723"
server_key_iv: "60920f38717d44712135ae9de3119b05"
server_key_version: "encryptionkey@0"
I20260808 14:57:34.335292 29752 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:57:34.338742 29778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:34.340006 29752 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:57:34.340199 29752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "a193a671ff144bc7838847c6d587a98d"
format_stamp: "Formatted at 2026-08-08 14:57:34 on dist-test-slave-z8x9"
server_key: "51ea43f74dafae5eb497b948a8aa6723"
server_key_iv: "60920f38717d44712135ae9de3119b05"
server_key_version: "encryptionkey@0"
I20260808 14:57:34.340407 29752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:34.359792 29752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:34.364267 29752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:34.364567 29752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:34.383299 29752 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:36193
I20260808 14:57:34.383332 29877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:36193 every 8 connection(s)
I20260808 14:57:34.384670 29752 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:57:34.388285 29878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:34.394976 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 29752
I20260808 14:57:34.395244 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:57:34.396092 12582 external_mini_cluster.cc:1428] Setting key 7bc069dd678584749ebd936282804d09
I20260808 14:57:34.399597 29878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d: Bootstrap starting.
I20260808 14:57:34.403079 29878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:34.404230 29878 log.cc:824] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:57:34.406948 29878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d: No bootstrap required, opened a new log
Aug 08 14:57:34 dist-test-slave-z8x9 krb5kdc[29729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:57:34.414597 29878 raft_consensus.cc:348] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a193a671ff144bc7838847c6d587a98d" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36193 } }
I20260808 14:57:34.414971 29878 raft_consensus.cc:374] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:34.415105 29878 raft_consensus.cc:729] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a193a671ff144bc7838847c6d587a98d, State: Initialized, Role: FOLLOWER
I20260808 14:57:34.415792 29878 consensus_queue.cc:260] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a193a671ff144bc7838847c6d587a98d" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36193 } }
I20260808 14:57:34.416061 29878 raft_consensus.cc:388] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:57:34.416222 29878 raft_consensus.cc:482] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:57:34.416428 29878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:34.418584 29884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:34.398194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49866 (local address 127.12.73.190:36193)
0808 14:57:34.398967 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:34.398978 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:34.399019 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:57:34.400758 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:34.400780 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:34.401152 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:34.401528 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:34.403415 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:34.404795 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:34.406138 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:34.406783 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:34.406980 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:34.410930 (+ 3950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:34.410937 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:34.410950 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:34.410989 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:34.414205 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:34.414892 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:34.414899 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:34.414905 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:34.415156 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:34.415658 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:34.415661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:34.415663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:34.416298 (+ 635us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:34.416639 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:34.417005 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 14:57:34.417547 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":369,"threads_started":1}
I20260808 14:57:34.419211 29878 raft_consensus.cc:504] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a193a671ff144bc7838847c6d587a98d" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36193 } }
I20260808 14:57:34.419710 29878 leader_election.cc:302] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a193a671ff144bc7838847c6d587a98d; no voters:
I20260808 14:57:34.420327 29878 leader_election.cc:288] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:57:34.420495 29888 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:57:34.421232 29888 raft_consensus.cc:686] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [term 1 LEADER]: Becoming Leader. State: Replica: a193a671ff144bc7838847c6d587a98d, State: Running, Role: LEADER
I20260808 14:57:34.422554 29888 consensus_queue.cc:237] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a193a671ff144bc7838847c6d587a98d" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36193 } }
I20260808 14:57:34.423156 29878 sys_catalog.cc:564] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:57:34.425235 29893 sys_catalog.cc:455] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a193a671ff144bc7838847c6d587a98d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a193a671ff144bc7838847c6d587a98d" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36193 } } }
I20260808 14:57:34.426283 29893 sys_catalog.cc:458] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [sys.catalog]: This master's current role is: LEADER
I20260808 14:57:34.425379 29890 sys_catalog.cc:455] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a193a671ff144bc7838847c6d587a98d. Latest consensus state: current_term: 1 leader_uuid: "a193a671ff144bc7838847c6d587a98d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a193a671ff144bc7838847c6d587a98d" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36193 } } }
I20260808 14:57:34.428268 29890 sys_catalog.cc:458] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d [sys.catalog]: This master's current role is: LEADER
I20260808 14:57:34.428442 29900 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:57:34.436853 29900 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:57:34.446432 29900 catalog_manager.cc:1347] Generated new cluster ID: 8e22e0cb3cdf4fbdaa9fa374b5f97f17
I20260808 14:57:34.446565 29900 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:57:34.462994 29900 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:57:34.464289 29900 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:57:34.481339 29900 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d: Generated new TSK 0
I20260808 14:57:34.482179 29900 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:57:34.551159 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36193
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:35441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:57:34.894686 29922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:34.895012 29922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:34.895192 29922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:34.902573 29922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:34.902733 29922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:34.902915 29922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:57:34.913214 29922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:34.914541 29922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:34.915838 29922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:34.929335 29934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:34.929363 29937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:34.929410 29940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:34.930642 29922 server_base.cc:1034] running on GCE node
I20260808 14:57:34.931257 29922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:34.932133 29922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:34.933365 29922 hybrid_clock.cc:648] HybridClock initialized: now 1786201054933310 us; error 43 us; skew 500 ppm
I20260808 14:57:34.933667 29922 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:57:34 dist-test-slave-z8x9 krb5kdc[29729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201054, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:57:34.936864 29922 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:57:34.938323 29922 webserver.cc:460] Webserver started at http://127.12.73.129:38595/ using document root <none> and password file <none>
I20260808 14:57:34.938952 29922 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:34.939052 29922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:34.939293 29922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:34.942134 29922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "d3cc13e719fa4b30af795fa43c0daf22"
format_stamp: "Formatted at 2026-08-08 14:57:34 on dist-test-slave-z8x9"
server_key: "0f2125e5c45c29809e5f49384c9015bc"
server_key_iv: "7d28fa76d86b941f34b85137c6a23116"
server_key_version: "encryptionkey@0"
I20260808 14:57:34.942837 29922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "d3cc13e719fa4b30af795fa43c0daf22"
format_stamp: "Formatted at 2026-08-08 14:57:34 on dist-test-slave-z8x9"
server_key: "0f2125e5c45c29809e5f49384c9015bc"
server_key_iv: "7d28fa76d86b941f34b85137c6a23116"
server_key_version: "encryptionkey@0"
I20260808 14:57:34.947747 29922 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:57:34.951081 29948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:34.952276 29922 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:57:34.952445 29922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "d3cc13e719fa4b30af795fa43c0daf22"
format_stamp: "Formatted at 2026-08-08 14:57:34 on dist-test-slave-z8x9"
server_key: "0f2125e5c45c29809e5f49384c9015bc"
server_key_iv: "7d28fa76d86b941f34b85137c6a23116"
server_key_version: "encryptionkey@0"
I20260808 14:57:34.952632 29922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:34.971740 29922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:34.975682 29922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:34.975999 29922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:34.977012 29922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:34.978399 29922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:34.978473 29922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:34.978616 29922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:34.978680 29922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:35.012948 29922 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:40229
I20260808 14:57:35.012995 30111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:40229 every 8 connection(s)
I20260808 14:57:35.014228 29922 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:57:35.021147 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 29922
I20260808 14:57:35.021423 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:57:35.022200 12582 external_mini_cluster.cc:1428] Setting key 250b0fcfee7603aab475631266ba3f96
Aug 08 14:57:35 dist-test-slave-z8x9 krb5kdc[29729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201054, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:57:35.036448 30114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:35.016661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:42733 (local address 127.12.73.190:36193)
0808 14:57:35.017156 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:35.017160 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:35.018012 (+ 852us) server_negotiation.cc:407] Connection header received
0808 14:57:35.019760 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:35.019766 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:35.019857 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:35.019973 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:35.021898 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:35.022731 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:35.024848 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:35.025319 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:35.025419 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:35.029546 (+ 4127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:35.029555 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:35.029562 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:35.029603 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:35.033100 (+ 3497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:35.033829 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:35.033842 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:35.033848 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:35.034004 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:35.034496 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:35.034503 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:35.034509 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:35.034916 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:35.035077 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:35.035713 (+ 636us) server_negotiation.cc:299] Negotiation successful
0808 14:57:35.035961 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":281,"threads_started":1}
I20260808 14:57:35.036947 30115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:35.017071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36193 (local address 127.12.73.129:42733)
0808 14:57:35.017857 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:35.017895 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:35.019480 (+ 1585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:35.020199 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:35.020207 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:35.020823 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:35.021713 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:35.021741 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:35.022913 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:35.022917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:35.024708 (+ 1791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:35.024723 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:35.025546 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:35.025556 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:35.025884 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:35.026617 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:35.026655 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:35.029335 (+ 2680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:35.033276 (+ 3941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:35.033282 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:35.033293 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:35.033707 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:35.034129 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:35.034137 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:35.034139 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:35.034375 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:35.035035 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:35.035041 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:35.035347 (+ 306us) client_negotiation.cc:769] Sending connection context
0808 14:57:35.035554 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 14:57:35.035908 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":275,"threads_started":1}
I20260808 14:57:35.038504 30112 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36193
I20260808 14:57:35.038792 30112 heartbeater.cc:464] Registering TS with master...
I20260808 14:57:35.039495 30112 heartbeater.cc:511] Master 127.12.73.190:36193 requested a full tablet report, sending...
I20260808 14:57:35.041746 29811 ts_manager.cc:194] Registered new tserver with Master: d3cc13e719fa4b30af795fa43c0daf22 (127.12.73.129:40229)
I20260808 14:57:35.043915 29811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:42733
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:57:35.087042 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36193
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:35441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:57:35.420439 30120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:35.420722 30120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:35.420817 30120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:35.428373 30120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:35.428484 30120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:35.428602 30120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:57:35.438352 30120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:35.439627 30120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:35.440856 30120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:35.454084 30127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:35.454137 30133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:35.454115 30128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:35.455328 30120 server_base.cc:1034] running on GCE node
I20260808 14:57:35.455945 30120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:35.456939 30120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:35.458160 30120 hybrid_clock.cc:648] HybridClock initialized: now 1786201055458077 us; error 70 us; skew 500 ppm
I20260808 14:57:35.458467 30120 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:57:35 dist-test-slave-z8x9 krb5kdc[29729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201055, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:57:35.461555 30120 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:57:35.462898 30120 webserver.cc:460] Webserver started at http://127.12.73.130:38951/ using document root <none> and password file <none>
I20260808 14:57:35.463577 30120 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:35.463719 30120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:35.464097 30120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:35.467020 30120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "8e9900124dc549f18ba6ef83960dd9dc"
format_stamp: "Formatted at 2026-08-08 14:57:35 on dist-test-slave-z8x9"
server_key: "d20e7b95b3c84cd7577170b7d2222db4"
server_key_iv: "67c585ce071d8548ef7124045e135c06"
server_key_version: "encryptionkey@0"
I20260808 14:57:35.467782 30120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "8e9900124dc549f18ba6ef83960dd9dc"
format_stamp: "Formatted at 2026-08-08 14:57:35 on dist-test-slave-z8x9"
server_key: "d20e7b95b3c84cd7577170b7d2222db4"
server_key_iv: "67c585ce071d8548ef7124045e135c06"
server_key_version: "encryptionkey@0"
I20260808 14:57:35.472710 30120 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 14:57:35.476060 30143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:35.477336 30120 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:57:35.477507 30120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "8e9900124dc549f18ba6ef83960dd9dc"
format_stamp: "Formatted at 2026-08-08 14:57:35 on dist-test-slave-z8x9"
server_key: "d20e7b95b3c84cd7577170b7d2222db4"
server_key_iv: "67c585ce071d8548ef7124045e135c06"
server_key_version: "encryptionkey@0"
I20260808 14:57:35.477703 30120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:35.506657 30120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:35.510752 30120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:35.511056 30120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:35.511966 30120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:35.513374 30120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:35.513474 30120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:35.513614 30120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:35.513695 30120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:35.548141 30120 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:35845
I20260808 14:57:35.548187 30313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:35845 every 8 connection(s)
I20260808 14:57:35.549533 30120 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:57:35.555815 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 30120
I20260808 14:57:35.556033 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:57:35.556537 12582 external_mini_cluster.cc:1428] Setting key f82451bf99e266fd7d5b5a9df808079e
Aug 08 14:57:35 dist-test-slave-z8x9 krb5kdc[29729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201055, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:57:35.570771 30317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:35.551907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:52431 (local address 127.12.73.190:36193)
0808 14:57:35.552524 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:35.552531 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:35.553572 (+ 1041us) server_negotiation.cc:407] Connection header received
0808 14:57:35.555283 (+ 1711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:35.555288 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:35.555356 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:35.555521 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:35.557326 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:35.558136 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:35.560404 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:35.560831 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:35.560928 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:35.565053 (+ 4125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:35.565058 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:35.565061 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:35.565092 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:35.567703 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:35.568430 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:35.568434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:35.568436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:35.568555 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:35.568998 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:35.569003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:35.569006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:35.569344 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:35.569498 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:35.570171 (+ 673us) server_negotiation.cc:299] Negotiation successful
0808 14:57:35.570405 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":326,"threads_started":1}
I20260808 14:57:35.571738 30318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:35.552563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36193 (local address 127.12.73.130:52431)
0808 14:57:35.553414 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:35.553458 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:35.555046 (+ 1588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:35.555777 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:35.555784 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:35.556414 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:35.557092 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:35.557109 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:35.558298 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:35.558303 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:35.560248 (+ 1945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:35.560268 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:35.561057 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:35.561067 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:35.561437 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:35.562141 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:35.562174 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:35.564803 (+ 2629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:35.567858 (+ 3055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:35.567866 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:35.567880 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:35.568290 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:35.568667 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:35.568672 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:35.568676 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:35.568875 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:35.569473 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:35.569481 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:35.569800 (+ 319us) client_negotiation.cc:769] Sending connection context
0808 14:57:35.570061 (+ 261us) client_negotiation.cc:240] Negotiation successful
0808 14:57:35.570570 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":349,"threads_started":1}
I20260808 14:57:35.573231 30314 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36193
I20260808 14:57:35.573542 30314 heartbeater.cc:464] Registering TS with master...
I20260808 14:57:35.574445 30314 heartbeater.cc:511] Master 127.12.73.190:36193 requested a full tablet report, sending...
I20260808 14:57:35.576004 29811 ts_manager.cc:194] Registered new tserver with Master: 8e9900124dc549f18ba6ef83960dd9dc (127.12.73.130:35845)
I20260808 14:57:35.576808 29811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:52431
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:57:35.621737 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36193
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:35441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:57:35.957218 30321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:57:35.957538 30321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:57:35.957700 30321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:57:35.964713 30321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:57:35.964856 30321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:57:35.965031 30321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:57:35.974432 30321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36193
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:57:35.975821 30321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:57:35.977270 30321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:57:35.990541 30327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:35.990500 30332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:57:35.990455 30328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:57:35.991285 30321 server_base.cc:1034] running on GCE node
I20260808 14:57:35.991941 30321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:57:35.992868 30321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:57:35.994093 30321 hybrid_clock.cc:648] HybridClock initialized: now 1786201055994055 us; error 68 us; skew 500 ppm
I20260808 14:57:35.994405 30321 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:57:35 dist-test-slave-z8x9 krb5kdc[29729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201055, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:57:35.997573 30321 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:57:35.998998 30321 webserver.cc:460] Webserver started at http://127.12.73.131:36915/ using document root <none> and password file <none>
I20260808 14:57:35.999662 30321 fs_manager.cc:359] Metadata directory not provided
I20260808 14:57:35.999809 30321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:57:36.000118 30321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:57:36.003002 30321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "6e88fad3427e43aea9c537daf945447a"
format_stamp: "Formatted at 2026-08-08 14:57:35 on dist-test-slave-z8x9"
server_key: "148efdd428c8fae9aff74ceebb0aa4f0"
server_key_iv: "1644be9989f9799221d03c7fda1b4c06"
server_key_version: "encryptionkey@0"
I20260808 14:57:36.003762 30321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "6e88fad3427e43aea9c537daf945447a"
format_stamp: "Formatted at 2026-08-08 14:57:35 on dist-test-slave-z8x9"
server_key: "148efdd428c8fae9aff74ceebb0aa4f0"
server_key_iv: "1644be9989f9799221d03c7fda1b4c06"
server_key_version: "encryptionkey@0"
I20260808 14:57:36.008898 30321 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 14:57:36.012303 30346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:36.013988 30321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:57:36.014144 30321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "6e88fad3427e43aea9c537daf945447a"
format_stamp: "Formatted at 2026-08-08 14:57:35 on dist-test-slave-z8x9"
server_key: "148efdd428c8fae9aff74ceebb0aa4f0"
server_key_iv: "1644be9989f9799221d03c7fda1b4c06"
server_key_version: "encryptionkey@0"
I20260808 14:57:36.014369 30321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:57:36.036052 30321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:57:36.039986 30321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:57:36.040234 30321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:57:36.041108 30321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:57:36.042379 30321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:57:36.042459 30321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:36.042555 30321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:57:36.042598 30321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:57:36.046912 30112 heartbeater.cc:503] Master 127.12.73.190:36193 was elected leader, sending a full tablet report...
I20260808 14:57:36.077775 30321 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:36019
I20260808 14:57:36.077836 30530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:36019 every 8 connection(s)
I20260808 14:57:36.079090 30321 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:57:36.080117 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 30321
I20260808 14:57:36.080329 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:57:36.080824 12582 external_mini_cluster.cc:1428] Setting key 3ea4d7fe02e2d0c385dd66c491208eda
Aug 08 14:57:36 dist-test-slave-z8x9 krb5kdc[29729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201055, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:57:36.100111 30533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.082148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:38109 (local address 127.12.73.190:36193)
0808 14:57:36.082609 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:36.082613 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:36.084127 (+ 1514us) server_negotiation.cc:407] Connection header received
0808 14:57:36.085840 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:36.085845 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:36.085926 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:36.086016 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:36.087486 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.088258 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.089826 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.090214 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.090318 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.094005 (+ 3687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:36.094011 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:36.094014 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:36.094052 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:36.096857 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:36.097714 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:36.097719 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:36.097722 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:36.097853 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:36.098304 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:36.098314 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:36.098316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:36.098590 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:36.098750 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:36.099484 (+ 734us) server_negotiation.cc:299] Negotiation successful
0808 14:57:36.099715 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":244,"threads_started":1}
I20260808 14:57:36.101080 30537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.082900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36193 (local address 127.12.73.131:38109)
0808 14:57:36.083823 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:36.083880 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:36.085599 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:36.086250 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:36.086259 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:36.086768 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:57:36.087338 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:36.087355 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.088390 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.088394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:36.089697 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:36.089710 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.090418 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.090423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:36.090610 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.091317 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:57:36.091346 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:57:36.093781 (+ 2435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:57:36.097011 (+ 3230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:36.097020 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:36.097037 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:36.097577 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:36.097969 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:57:36.097974 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:57:36.097978 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:57:36.098178 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:57:36.098724 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:57:36.098733 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:57:36.099108 (+ 375us) client_negotiation.cc:769] Sending connection context
0808 14:57:36.099380 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 14:57:36.099947 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":363,"threads_started":1}
I20260808 14:57:36.102535 30531 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36193
I20260808 14:57:36.102875 30531 heartbeater.cc:464] Registering TS with master...
I20260808 14:57:36.103660 30531 heartbeater.cc:511] Master 127.12.73.190:36193 requested a full tablet report, sending...
I20260808 14:57:36.105054 29811 ts_manager.cc:194] Registered new tserver with Master: 6e88fad3427e43aea9c537daf945447a (127.12.73.131:36019)
I20260808 14:57:36.105895 29811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:38109
I20260808 14:57:36.109287 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:57:36.126586 30533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.113713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49874 (local address 127.12.73.190:36193)
0808 14:57:36.113879 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:36.113884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:36.114411 (+ 527us) server_negotiation.cc:407] Connection header received
0808 14:57:36.114613 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:36.114617 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:36.114691 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:36.114794 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:36.116216 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.116944 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.118271 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.118766 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.118895 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.121276 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:36.121284 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:36.121293 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:36.121323 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:36.123860 (+ 2537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:36.124512 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:36.124517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:36.124521 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:36.124646 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:36.125048 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:36.125053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:36.125057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:36.125449 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:36.125718 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:36.126046 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 14:57:36.126278 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 14:57:36.130437 29811 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49874:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:57:36.137486 29811 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:57:36.160554 30552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.149290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:40229 (local address 127.0.0.1:58560)
0808 14:57:36.150326 (+ 1036us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:36.150384 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:36.150598 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:36.152560 (+ 1962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:36.152567 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:36.152593 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:57:36.153088 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:36.153102 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.155250 (+ 2148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.155255 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:36.157705 (+ 2450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:36.157718 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.159450 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.159458 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:36.159655 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.159719 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 14:57:36.159820 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:57:36.160028 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"mutex_wait_us":76,"thread_start_us":531,"threads_started":1}
I20260808 14:57:36.161144 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.150264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52944 (local address 127.12.73.130:35845)
0808 14:57:36.151297 (+ 1033us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:36.151310 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:36.152502 (+ 1192us) server_negotiation.cc:407] Connection header received
0808 14:57:36.152608 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:36.152615 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:36.152859 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:36.153047 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:57:36.153871 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.155035 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.158242 (+ 3207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.159679 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.159839 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.160036 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:36.160673 (+ 637us) server_negotiation.cc:299] Negotiation successful
0808 14:57:36.160840 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":692,"threads_started":1}
I20260808 14:57:36.161383 30558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.150683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:36019 (local address 127.0.0.1:45956)
0808 14:57:36.152449 (+ 1766us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:36.152467 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:36.152568 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:36.153748 (+ 1180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:36.153751 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:36.153776 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:57:36.154171 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:36.154186 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.156095 (+ 1909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.156100 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:36.158407 (+ 2307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:36.158417 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.160276 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.160283 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:36.160461 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.160507 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:57:36.160617 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:57:36.160874 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1635,"mutex_wait_us":72,"thread_start_us":1475,"threads_started":1}
I20260808 14:57:36.161610 30562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.151300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45956 (local address 127.12.73.131:36019)
0808 14:57:36.153195 (+ 1895us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:36.153206 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:36.153238 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:57:36.153331 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:36.153338 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:36.153545 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:36.153741 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:57:36.154362 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.155919 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.158553 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.159973 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.160180 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.160414 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:36.160673 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 14:57:36.161024 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1674,"thread_start_us":1804,"threads_started":1}
I20260808 14:57:36.161898 30556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.149633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58560 (local address 127.12.73.129:40229)
0808 14:57:36.151879 (+ 2246us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:36.151887 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:36.151915 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:57:36.152015 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:36.152024 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:36.152297 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:36.153308 (+ 1011us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:57:36.153584 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.155099 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.157861 (+ 2762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.159221 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.161054 (+ 1833us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.161303 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:36.161385 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 14:57:36.161551 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2051,"thread_start_us":1875,"threads_started":1}
I20260808 14:57:36.162349 30553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.149420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:35845 (local address 127.0.0.1:52944)
0808 14:57:36.152209 (+ 2789us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:36.152227 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:36.152369 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:36.153260 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:36.153264 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:36.153288 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:57:36.153571 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:36.153579 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.155224 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.155229 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:36.158065 (+ 2836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:36.158081 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.159907 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.159914 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:36.160122 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.160154 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 14:57:36.160289 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 14:57:36.160426 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2626,"mutex_wait_us":37,"thread_start_us":2446,"threads_started":1}
I20260808 14:57:36.165474 30214 tablet_service.cc:1467] Processing CreateTablet for tablet decbe8df1464456aaa721a6565b3b1c7 (DEFAULT_TABLE table=test-table [id=a90c3815b21b410b8bd65b388db629a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:36.165474 30020 tablet_service.cc:1467] Processing CreateTablet for tablet decbe8df1464456aaa721a6565b3b1c7 (DEFAULT_TABLE table=test-table [id=a90c3815b21b410b8bd65b388db629a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:36.165475 30419 tablet_service.cc:1467] Processing CreateTablet for tablet decbe8df1464456aaa721a6565b3b1c7 (DEFAULT_TABLE table=test-table [id=a90c3815b21b410b8bd65b388db629a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:57:36.166644 30214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet decbe8df1464456aaa721a6565b3b1c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:36.166862 30020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet decbe8df1464456aaa721a6565b3b1c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:36.166860 30419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet decbe8df1464456aaa721a6565b3b1c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:57:36.177968 30563 tablet_bootstrap.cc:492] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc: Bootstrap starting.
I20260808 14:57:36.181483 30563 tablet_bootstrap.cc:654] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:36.182914 30563 log.cc:824] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:57:36.187232 30564 tablet_bootstrap.cc:492] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a: Bootstrap starting.
I20260808 14:57:36.187233 30565 tablet_bootstrap.cc:492] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22: Bootstrap starting.
I20260808 14:57:36.190908 30564 tablet_bootstrap.cc:654] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:36.190917 30565 tablet_bootstrap.cc:654] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22: Neither blocks nor log segments found. Creating new log.
I20260808 14:57:36.192214 30564 log.cc:824] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:57:36.192214 30565 log.cc:824] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22: Log is configured to *not* fsync() on all Append() calls
I20260808 14:57:36.195194 30563 tablet_bootstrap.cc:492] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc: No bootstrap required, opened a new log
I20260808 14:57:36.195503 30563 ts_tablet_manager.cc:1397] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.011s
I20260808 14:57:36.195856 30564 tablet_bootstrap.cc:492] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a: No bootstrap required, opened a new log
I20260808 14:57:36.195854 30565 tablet_bootstrap.cc:492] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22: No bootstrap required, opened a new log
I20260808 14:57:36.196111 30565 ts_tablet_manager.cc:1397] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260808 14:57:36.196118 30564 ts_tablet_manager.cc:1397] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 14:57:36.202777 30563 raft_consensus.cc:348] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cc13e719fa4b30af795fa43c0daf22" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40229 } } peers { permanent_uuid: "8e9900124dc549f18ba6ef83960dd9dc" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35845 } } peers { permanent_uuid: "6e88fad3427e43aea9c537daf945447a" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 36019 } }
I20260808 14:57:36.203240 30563 raft_consensus.cc:374] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:36.203353 30563 raft_consensus.cc:729] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e9900124dc549f18ba6ef83960dd9dc, State: Initialized, Role: FOLLOWER
I20260808 14:57:36.203928 30563 consensus_queue.cc:260] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cc13e719fa4b30af795fa43c0daf22" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40229 } } peers { permanent_uuid: "8e9900124dc549f18ba6ef83960dd9dc" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35845 } } peers { permanent_uuid: "6e88fad3427e43aea9c537daf945447a" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 36019 } }
I20260808 14:57:36.206883 30565 raft_consensus.cc:348] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cc13e719fa4b30af795fa43c0daf22" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40229 } } peers { permanent_uuid: "8e9900124dc549f18ba6ef83960dd9dc" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35845 } } peers { permanent_uuid: "6e88fad3427e43aea9c537daf945447a" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 36019 } }
I20260808 14:57:36.206883 30564 raft_consensus.cc:348] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cc13e719fa4b30af795fa43c0daf22" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40229 } } peers { permanent_uuid: "8e9900124dc549f18ba6ef83960dd9dc" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35845 } } peers { permanent_uuid: "6e88fad3427e43aea9c537daf945447a" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 36019 } }
I20260808 14:57:36.207291 30564 raft_consensus.cc:374] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:36.207302 30565 raft_consensus.cc:374] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:57:36.207402 30564 raft_consensus.cc:729] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e88fad3427e43aea9c537daf945447a, State: Initialized, Role: FOLLOWER
I20260808 14:57:36.207409 30565 raft_consensus.cc:729] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cc13e719fa4b30af795fa43c0daf22, State: Initialized, Role: FOLLOWER
I20260808 14:57:36.208159 30314 heartbeater.cc:503] Master 127.12.73.190:36193 was elected leader, sending a full tablet report...
I20260808 14:57:36.208038 30564 consensus_queue.cc:260] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cc13e719fa4b30af795fa43c0daf22" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40229 } } peers { permanent_uuid: "8e9900124dc549f18ba6ef83960dd9dc" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35845 } } peers { permanent_uuid: "6e88fad3427e43aea9c537daf945447a" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 36019 } }
I20260808 14:57:36.208701 30563 ts_tablet_manager.cc:1428] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc: Time spent starting tablet: real 0.013s user 0.009s sys 0.003s
I20260808 14:57:36.208966 30565 consensus_queue.cc:260] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cc13e719fa4b30af795fa43c0daf22" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40229 } } peers { permanent_uuid: "8e9900124dc549f18ba6ef83960dd9dc" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35845 } } peers { permanent_uuid: "6e88fad3427e43aea9c537daf945447a" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 36019 } }
I20260808 14:57:36.209604 30531 heartbeater.cc:503] Master 127.12.73.190:36193 was elected leader, sending a full tablet report...
I20260808 14:57:36.211136 30565 ts_tablet_manager.cc:1428] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260808 14:57:36.212222 30564 ts_tablet_manager.cc:1428] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a: Time spent starting tablet: real 0.016s user 0.010s sys 0.005s
W20260808 14:57:36.266566 30113 tablet.cc:2369] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:57:36.301679 30315 tablet.cc:2369] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:57:36.330828 30532 tablet.cc:2369] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:57:36.513598 30571 raft_consensus.cc:482] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:57:36.513895 30571 raft_consensus.cc:504] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cc13e719fa4b30af795fa43c0daf22" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40229 } } peers { permanent_uuid: "8e9900124dc549f18ba6ef83960dd9dc" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35845 } } peers { permanent_uuid: "6e88fad3427e43aea9c537daf945447a" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 36019 } }
I20260808 14:57:36.515658 30571 leader_election.cc:288] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cc13e719fa4b30af795fa43c0daf22 (127.12.73.129:40229), 8e9900124dc549f18ba6ef83960dd9dc (127.12.73.130:35845)
I20260808 14:57:36.522908 30537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.516074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:35845 (local address 127.12.73.131:46335)
0808 14:57:36.516465 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:36.516487 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:36.516632 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:36.517149 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:36.517154 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:36.517205 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:57:36.517481 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:36.517491 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.518672 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.518676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:36.520698 (+ 2022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:36.520713 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.522198 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.522205 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:36.522358 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.522384 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 14:57:36.522471 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:57:36.522567 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"spinlock_wait_cycles":31104}
I20260808 14:57:36.523095 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.516320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:46335 (local address 127.12.73.130:35845)
0808 14:57:36.516537 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:36.516543 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:36.516564 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:57:36.516820 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:36.516829 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:36.516922 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:36.517023 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:57:36.517629 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.518536 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.520874 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.522024 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.522223 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.522304 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:36.522523 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 14:57:36.522661 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:57:36.523729 30556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.516071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:40627 (local address 127.12.73.129:40229)
0808 14:57:36.516301 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:36.516310 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:36.517103 (+ 793us) server_negotiation.cc:407] Connection header received
0808 14:57:36.517722 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:36.517729 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:36.517807 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:36.517907 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:57:36.518467 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.519262 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.521480 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.522707 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.522928 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.523001 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:36.523410 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 14:57:36.523508 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:57:36.523965 30574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.516122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:40229 (local address 127.12.73.131:40627)
0808 14:57:36.516995 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0808 14:57:36.517014 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:57:36.517275 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:57:36.517949 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:57:36.517953 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:57:36.517978 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:57:36.518312 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:36.518320 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.519412 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.519417 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:36.521322 (+ 1905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:57:36.521333 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.523000 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.523006 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:57:36.523189 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.523237 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:57:36.523367 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 14:57:36.523511 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"mutex_wait_us":4,"thread_start_us":727,"threads_started":1}
I20260808 14:57:36.524325 30242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "decbe8df1464456aaa721a6565b3b1c7" candidate_uuid: "6e88fad3427e43aea9c537daf945447a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e9900124dc549f18ba6ef83960dd9dc" is_pre_election: true
I20260808 14:57:36.524860 30242 raft_consensus.cc:2454] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e88fad3427e43aea9c537daf945447a in term 0.
I20260808 14:57:36.524972 30052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "decbe8df1464456aaa721a6565b3b1c7" candidate_uuid: "6e88fad3427e43aea9c537daf945447a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cc13e719fa4b30af795fa43c0daf22" is_pre_election: true
I20260808 14:57:36.525555 30052 raft_consensus.cc:2454] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e88fad3427e43aea9c537daf945447a in term 0.
I20260808 14:57:36.525589 30350 leader_election.cc:302] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e88fad3427e43aea9c537daf945447a, 8e9900124dc549f18ba6ef83960dd9dc; no voters:
I20260808 14:57:36.526019 30571 raft_consensus.cc:2781] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:57:36.526213 30571 raft_consensus.cc:482] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:57:36.526357 30571 raft_consensus.cc:3037] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:36.528609 30571 raft_consensus.cc:504] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cc13e719fa4b30af795fa43c0daf22" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40229 } } peers { permanent_uuid: "8e9900124dc549f18ba6ef83960dd9dc" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35845 } } peers { permanent_uuid: "6e88fad3427e43aea9c537daf945447a" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 36019 } }
I20260808 14:57:36.529287 30571 leader_election.cc:288] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [CANDIDATE]: Term 1 election: Requested vote from peers d3cc13e719fa4b30af795fa43c0daf22 (127.12.73.129:40229), 8e9900124dc549f18ba6ef83960dd9dc (127.12.73.130:35845)
I20260808 14:57:36.529793 30052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "decbe8df1464456aaa721a6565b3b1c7" candidate_uuid: "6e88fad3427e43aea9c537daf945447a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cc13e719fa4b30af795fa43c0daf22"
I20260808 14:57:36.529847 30242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "decbe8df1464456aaa721a6565b3b1c7" candidate_uuid: "6e88fad3427e43aea9c537daf945447a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e9900124dc549f18ba6ef83960dd9dc"
I20260808 14:57:36.530004 30052 raft_consensus.cc:3037] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:36.530056 30242 raft_consensus.cc:3037] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:57:36.532225 30052 raft_consensus.cc:2454] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e88fad3427e43aea9c537daf945447a in term 1.
I20260808 14:57:36.532544 30242 raft_consensus.cc:2454] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e88fad3427e43aea9c537daf945447a in term 1.
I20260808 14:57:36.532653 30351 leader_election.cc:302] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e88fad3427e43aea9c537daf945447a, d3cc13e719fa4b30af795fa43c0daf22; no voters:
I20260808 14:57:36.533025 30571 raft_consensus.cc:2781] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:57:36.533519 30571 raft_consensus.cc:686] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 1 LEADER]: Becoming Leader. State: Replica: 6e88fad3427e43aea9c537daf945447a, State: Running, Role: LEADER
I20260808 14:57:36.534106 30571 consensus_queue.cc:237] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cc13e719fa4b30af795fa43c0daf22" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40229 } } peers { permanent_uuid: "8e9900124dc549f18ba6ef83960dd9dc" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35845 } } peers { permanent_uuid: "6e88fad3427e43aea9c537daf945447a" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 36019 } }
I20260808 14:57:36.539054 29806 catalog_manager.cc:5495] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e88fad3427e43aea9c537daf945447a (127.12.73.131). New cstate: current_term: 1 leader_uuid: "6e88fad3427e43aea9c537daf945447a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cc13e719fa4b30af795fa43c0daf22" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e9900124dc549f18ba6ef83960dd9dc" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e88fad3427e43aea9c537daf945447a" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 36019 } health_report { overall_health: HEALTHY } } }
I20260808 14:57:36.618317 30562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.613282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45972 (local address 127.12.73.131:36019)
0808 14:57:36.613472 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:36.613477 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:36.613541 (+ 64us) server_negotiation.cc:407] Connection header received
0808 14:57:36.613728 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:36.613732 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:36.613821 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:36.613968 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:57:36.614326 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.615077 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.616341 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.616740 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.616837 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.617325 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:57:36.617850 (+ 525us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:57:36.617963 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:36.618037 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 14:57:36.618102 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:57:36.626979 30242 raft_consensus.cc:1261] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc [term 1 FOLLOWER]: Refusing update from remote peer 6e88fad3427e43aea9c537daf945447a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:57:36.627023 30052 raft_consensus.cc:1261] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22 [term 1 FOLLOWER]: Refusing update from remote peer 6e88fad3427e43aea9c537daf945447a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:57:36.627995 30578 consensus_queue.cc:1035] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cc13e719fa4b30af795fa43c0daf22" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:57:36.628368 30571 consensus_queue.cc:1035] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e9900124dc549f18ba6ef83960dd9dc" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:57:36.655512 29806 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:57:36.655870 29806 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:57:36.659812 29806 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a193a671ff144bc7838847c6d587a98d: Sending DeleteTablet for 3 replicas of tablet decbe8df1464456aaa721a6565b3b1c7
I20260808 14:57:36.661067 30214 tablet_service.cc:1514] Processing DeleteTablet for tablet decbe8df1464456aaa721a6565b3b1c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:36 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:52944
I20260808 14:57:36.661484 30020 tablet_service.cc:1514] Processing DeleteTablet for tablet decbe8df1464456aaa721a6565b3b1c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:36 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:58560
I20260808 14:57:36.662918 30419 tablet_service.cc:1514] Processing DeleteTablet for tablet decbe8df1464456aaa721a6565b3b1c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:57:36 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:45956
I20260808 14:57:36.665143 30599 tablet_replica.cc:330] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc: stopping tablet replica
I20260808 14:57:36.665722 30599 raft_consensus.cc:2229] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:57:36.666337 30599 raft_consensus.cc:2258] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:36.669049 30599 ts_tablet_manager.cc:1905] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:36.671120 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 29922
I20260808 14:57:36.677799 30601 tablet_replica.cc:330] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22: stopping tablet replica
I20260808 14:57:36.678499 30599 ts_tablet_manager.cc:1918] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:57:36.678491 30601 raft_consensus.cc:2229] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:57:36.678701 30599 log.cc:1196] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/decbe8df1464456aaa721a6565b3b1c7
I20260808 14:57:36.679282 30599 ts_tablet_manager.cc:1939] T decbe8df1464456aaa721a6565b3b1c7 P 8e9900124dc549f18ba6ef83960dd9dc: Deleting consensus metadata
I20260808 14:57:36.679316 30601 raft_consensus.cc:2258] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:36.681417 29779 catalog_manager.cc:4841] TS 8e9900124dc549f18ba6ef83960dd9dc (127.12.73.130:35845): tablet decbe8df1464456aaa721a6565b3b1c7 (table test-table [id=a90c3815b21b410b8bd65b388db629a3]) successfully deleted
I20260808 14:57:36.681943 30601 ts_tablet_manager.cc:1905] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:57:36.687278 30601 ts_tablet_manager.cc:1918] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:57:36.687463 30601 log.cc:1196] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/decbe8df1464456aaa721a6565b3b1c7
I20260808 14:57:36.688047 30601 ts_tablet_manager.cc:1939] T decbe8df1464456aaa721a6565b3b1c7 P d3cc13e719fa4b30af795fa43c0daf22: Deleting consensus metadata
I20260808 14:57:36.688944 30603 tablet_replica.cc:330] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a: stopping tablet replica
I20260808 14:57:36.689512 30603 raft_consensus.cc:2229] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:57:36.690057 29780 catalog_manager.cc:4841] TS d3cc13e719fa4b30af795fa43c0daf22 (127.12.73.129:40229): tablet decbe8df1464456aaa721a6565b3b1c7 (table test-table [id=a90c3815b21b410b8bd65b388db629a3]) successfully deleted
I20260808 14:57:36.690388 30603 raft_consensus.cc:2258] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:57:36.692788 30603 ts_tablet_manager.cc:1905] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 14:57:36 dist-test-slave-z8x9 krb5kdc[29729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:57:36.700677 30603 ts_tablet_manager.cc:1918] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:57:36.700881 30603 log.cc:1196] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/decbe8df1464456aaa721a6565b3b1c7
I20260808 14:57:36.701542 30603 ts_tablet_manager.cc:1939] T decbe8df1464456aaa721a6565b3b1c7 P 6e88fad3427e43aea9c537daf945447a: Deleting consensus metadata
I20260808 14:57:36.703562 29780 catalog_manager.cc:4841] TS 6e88fad3427e43aea9c537daf945447a (127.12.73.131:36019): tablet decbe8df1464456aaa721a6565b3b1c7 (table test-table [id=a90c3815b21b410b8bd65b388db629a3]) successfully deleted
I20260808 14:57:36.704244 30556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.672861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58574 (local address 127.12.73.129:40229)
0808 14:57:36.673047 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:36.673053 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:36.688092 (+ 15039us) server_negotiation.cc:407] Connection header received
0808 14:57:36.688395 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:36.688402 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:36.688507 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:36.688631 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:36.690560 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.691494 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.692765 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.693478 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.693654 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.697884 (+ 4230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:36.697898 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:36.697917 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:36.697962 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:36.701083 (+ 3121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:36.701898 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:36.701911 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:36.701913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:36.702049 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:36.702478 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:36.702482 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:36.702487 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:36.702877 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:36.703199 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:36.703587 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 14:57:36.703842 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:57:36.705001 30106 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:36.798592 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 29922
I20260808 14:57:36.829999 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 30120
Aug 08 14:57:36 dist-test-slave-z8x9 krb5kdc[29729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:57:36.845786 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.830938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52954 (local address 127.12.73.130:35845)
0808 14:57:36.831161 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:36.831167 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:36.831188 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:57:36.831359 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:36.831365 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:36.831439 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:36.831550 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:36.832831 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.833686 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.835004 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.835410 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.835549 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.839917 (+ 4368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:36.839932 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:36.839946 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:36.839983 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:36.842831 (+ 2848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:36.843501 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:36.843513 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:36.843519 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:36.843674 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:36.844055 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:36.844062 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:36.844065 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:36.844440 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:36.844750 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:36.845069 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 14:57:36.845452 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 14:57:36.846550 30309 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:36.938069 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 30120
I20260808 14:57:36.965142 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 30321
Aug 08 14:57:36 dist-test-slave-z8x9 krb5kdc[29729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:57:36.985280 30562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:57:36.966360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45978 (local address 127.12.73.131:36019)
0808 14:57:36.966535 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:57:36.966539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:57:36.966559 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:57:36.966660 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:57:36.966664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:57:36.966728 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:57:36.966811 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:57:36.968861 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.969757 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.971835 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:57:36.972282 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:57:36.972400 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:57:36.978847 (+ 6447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:57:36.978862 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:57:36.978882 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:57:36.978923 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:57:36.982167 (+ 3244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:36.983120 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:36.983128 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:36.983130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:36.983294 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:57:36.983764 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:57:36.983768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:57:36.983770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:57:36.984141 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:57:36.984393 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0808 14:57:36.984752 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 14:57:36.984915 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:57:36.986179 30526 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:37.111797 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 30321
I20260808 14:57:37.138957 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 29752
I20260808 14:57:37.140220 29870 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:57:37.250571 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 29752
2026-08-08T14:57:37Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4944 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:57:37 dist-test-slave-z8x9 krb5kdc[30617](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:57:37 dist-test-slave-z8x9 krb5kdc[30617](info): set up 2 sockets
Aug 08 14:57:37 dist-test-slave-z8x9 krb5kdc[30617](info): commencing operation
krb5kdc: starting...
W20260808 14:57:38.615530 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.314s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:57:38 dist-test-slave-z8x9 krb5kdc[30617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:57:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:57:38Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.73.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.73.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/rangeradmin_127.12.73.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/rangeradmin_127.12.73.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.73.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.73.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/rangerlookup_127.12.73.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/rangerlookup_127.12.73.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.73.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.73.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/HTTP_127.12.73.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/HTTP_127.12.73.148@KRBTEST.COM.keytab.
I20260808 14:57:39.012154 12582 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasktuKHj1/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/postgres -l logfile start
2026-08-08 14:57:41.562 UTC [30669] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 14:57:41.562 UTC [30669] LOG: listening on IPv4 address "127.12.73.148", port 59927
2026-08-08 14:57:41.566 UTC [30669] LOG: listening on Unix socket "/tmp/.s.PGSQL.59927"
2026-08-08 14:57:41.591 UTC [30672] LOG: database system was shut down at 2026-08-08 14:57:40 UTC
2026-08-08 14:57:41.595 UTC [30669] LOG: database system is ready to accept connections
I20260808 14:57:42.811174 12582 mini_postgres.cc:96] Postgres bound to 59927
2026-08-08 14:57:42.837 UTC [30684] FATAL: database "slave" does not exist
127.12.73.148:59927 - accepting connections
I20260808 14:57:42.838577 12582 mini_ranger.cc:161] Starting Ranger...
I20260808 14:57:42.872017 12582 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 14:57:43.340847 12582 mini_ranger.cc:87] Created ranger Postgres database
I20260808 14:57:43.340967 12582 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-admin
2026-08-08 14:57:43,687 [I] DB FLAVOR :POSTGRES
2026-08-08 14:57:43,688 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:57:43,688 [I] Checking connection..
2026-08-08 14:57:43,688 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 14:57:43,947 [I] Checking connection passed.
2026-08-08 14:57:43,947 [I] --------- Verifying version history table ---------
2026-08-08 14:57:43,947 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:57:44,205 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:57:44,205 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:57:44,443 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:57:44,443 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 14:57:44,443 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 14:57:44.726 UTC [30793] WARNING: there is no transaction in progress
2026-08-08 14:57:44,733 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 14:57:44,733 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:57:44,995 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 14:57:44,996 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:57:44,996 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 14:57:45,264 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 14:57:45,513 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-z8x9.c.gcp-upstream.internal','N') ;"
2026-08-08 14:57:45,736 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:57:46,003 [I] Table x_portal_user does not exist in database ranger
2026-08-08 14:57:46,003 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:57:46,257 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 14:57:46,257 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:57:46,529 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:57:46,794 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 14:57:46,794 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 14:57:47.729 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.745 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.761 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.777 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.792 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.809 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.870 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.877 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.891 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.900 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.910 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.923 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.933 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.940 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.946 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:47.953 UTC [30968] WARNING: there is no transaction in progress
2026-08-08 14:57:48,562 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 14:57:48,562 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 14:57:48,819 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 14:57:48,819 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:57:49,075 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 14:57:49,076 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:57:49,344 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 14:57:49,344 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:57:49,609 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:57:49,856 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-z8x9.c.gcp-upstream.internal';"
2026-08-08 14:57:50,091 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 14:57:50,091 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 14:57:50,336 [I] DB_PATCHES have already been applied
I20260808 14:57:50.342401 12582 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-admin:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasktuKHj1/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 14:57:50.342491 12582 mini_ranger.cc:193] Using host: 127.12.73.148
I20260808 14:57:50.365002 12582 mini_ranger.cc:227] Ranger admin URL: http://127.12.73.148:44475
Aug 08, 2026 2:57:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:57:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:57:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:57:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:57:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:57:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:57:51 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 14:57:51.782006 12582 mini_ranger.cc:160] Time spent starting Ranger: real 8.943s user 0.007s sys 0.058s
Aug 08, 2026 2:58:11 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:58:11 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 08, 2026 2:58:11 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:58:11 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:58:11 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:58:12 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 14:58:12.908017 12582 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.73.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.73.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/rangerkms_127.12.73.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/rangerkms_127.12.73.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.73.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.73.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.73.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/HTTP_127.12.73.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.73.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/HTTP_127.12.73.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 14:58:13 dist-test-slave-z8x9 krb5kdc[30617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201093, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 14:58:13.121403 12582 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 14:58:13.149041 12582 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 14:58:14.019793 12582 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 14:58:14.019987 12582 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-kms
I20260808 14:58:14.020130 12582 mini_ranger_kms.cc:227] Using postgres at 127.12.73.148:59927
2026-08-08 14:58:14,588 [I] DB FLAVOR :POSTGRES
2026-08-08 14:58:14,588 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:58:14,588 [I] Checking connection
2026-08-08 14:58:14,588 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 14:58:14,852 [I] connection success
2026-08-08 14:58:14,852 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 14:58:14,852 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 14:58:14,852 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 14:58:15,122 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 14:58:15,123 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:58:15,123 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 14:58:15,123 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:59927/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 14:58:15,395 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 14:58:15.846572 12582 mini_ranger_kms.cc:310] Created kms service
I20260808 14:58:16.029594 12582 mini_ranger_kms.cc:326] Created kudu user
I20260808 14:58:16.074770 12582 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 14:58:16 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201093, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:58:16.498064 12582 mini_ranger_kms.cc:384] Added ranger policy
I20260808 14:58:16.499678 12582 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-kms:/tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 14:58:16.499760 12582 mini_ranger_kms.cc:240] Using host: 127.12.73.148
I20260808 14:58:16.528513 12582 mini_ranger_kms.cc:276] Ranger KMS PID: 31249
I20260808 14:58:16.528676 12582 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.73.148:39545
Aug 08, 2026 2:58:17 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:58:17 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:58:17 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:58:17 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:58:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:58:18 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 14:58:18 dist-test-slave-z8x9 krb5kdc[30617](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786201098, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.73.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:58:19.350086 12582 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.229s user 0.129s sys 0.441s
I20260808 14:58:19.350484 12582 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 14:58:19.350733 12582 mini_ranger_kms.cc:401] 127.12.73.148:39545/kms/v1/keys
Aug 08 14:58:19 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201098, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.73.148@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
Aug 08 14:58:19 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201098, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.73.148@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
Aug 08 14:58:21 dist-test-slave-z8x9 krb5kdc[30617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:58:22.064502 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34005
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:34005
--ranger_config_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.73.148:39545/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:58:22.412294 31321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:58:22.412583 31321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:58:22.412763 31321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:58:22.420107 31321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:58:22.420279 31321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:58:22.420393 31321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:58:22.420488 31321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:58:22.420570 31321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:58:22.430810 31321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.73.148:39545/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:34005
--ranger_config_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:58:22.432034 31321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:58:22.433379 31321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:58:22.445992 31334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:58:22.446074 31328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:58:22.446097 31330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:58:22.447083 31321 server_base.cc:1034] running on GCE node
I20260808 14:58:22.447963 31321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:58:22.449558 31321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:58:22.450911 31321 hybrid_clock.cc:648] HybridClock initialized: now 1786201102450868 us; error 39 us; skew 500 ppm
I20260808 14:58:22.451290 31321 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:58:22 dist-test-slave-z8x9 krb5kdc[30617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201102, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:58:22.454555 31321 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:58:22.455950 31321 webserver.cc:460] Webserver started at http://127.12.73.190:41169/ using document root <none> and password file <none>
I20260808 14:58:22.456611 31321 fs_manager.cc:359] Metadata directory not provided
I20260808 14:58:22.456756 31321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:58:22.457069 31321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:58:22 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201102, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:58:22.514488 31321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "bf0639c870a14aa9973ec9ee474312a6"
format_stamp: "Formatted at 2026-08-08 14:58:22 on dist-test-slave-z8x9"
server_key: "a03494c872f2aa84f4c84473a38819bf"
server_key_iv: "ad88d5e3014788b1dcbce16cce805b54"
server_key_version: "kuduclusterkey@0"
I20260808 14:58:22.515379 31321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "bf0639c870a14aa9973ec9ee474312a6"
format_stamp: "Formatted at 2026-08-08 14:58:22 on dist-test-slave-z8x9"
server_key: "a03494c872f2aa84f4c84473a38819bf"
server_key_iv: "ad88d5e3014788b1dcbce16cce805b54"
server_key_version: "kuduclusterkey@0"
I20260808 14:58:22.521445 31321 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 14:58:22.542215 31343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:58:22.543783 31321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:58:22.543974 31321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "bf0639c870a14aa9973ec9ee474312a6"
format_stamp: "Formatted at 2026-08-08 14:58:22 on dist-test-slave-z8x9"
server_key: "a03494c872f2aa84f4c84473a38819bf"
server_key_iv: "ad88d5e3014788b1dcbce16cce805b54"
server_key_version: "kuduclusterkey@0"
I20260808 14:58:22.544235 31321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:58:22.560472 31321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:58:22.564715 31321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:58:22.565040 31321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:58:22.586125 31321 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:34005
I20260808 14:58:22.586151 31424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:34005 every 8 connection(s)
I20260808 14:58:22.587524 31321 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:58:22.588268 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 31321
I20260808 14:58:22.588502 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:58:22.589255 12582 external_mini_cluster.cc:1428] Setting key 8a1ebee258d880aedee26e5989a23395
I20260808 14:58:22.592495 31425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 14:58:22 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:58:22.605685 31425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6: Bootstrap starting.
I20260808 14:58:22.608856 31425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6: Neither blocks nor log segments found. Creating new log.
I20260808 14:58:22.609995 31425 log.cc:824] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:58:22.612726 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:22.591490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47532 (local address 127.12.73.190:34005)
0808 14:58:22.592292 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:22.592303 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:22.592344 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:58:22.594123 (+ 1779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:22.594146 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:22.594500 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:22.594816 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:58:22.596430 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:22.597896 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:22.599637 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:22.600341 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:22.600462 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:22.605149 (+ 4687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:58:22.605156 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:58:22.605224 (+ 68us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:58:22.605267 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:58:22.608286 (+ 3019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:22.609005 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:22.609020 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:22.609027 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:22.609255 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:22.609655 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:22.609661 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:22.609664 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:22.610196 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:58:22.610502 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:22.610975 (+ 473us) server_negotiation.cc:299] Negotiation successful
0808 14:58:22.611443 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":375,"threads_started":1}
I20260808 14:58:22.613466 31425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6: No bootstrap required, opened a new log
I20260808 14:58:22.620901 31425 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0639c870a14aa9973ec9ee474312a6" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34005 } }
I20260808 14:58:22.621374 31425 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:58:22.621491 31425 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf0639c870a14aa9973ec9ee474312a6, State: Initialized, Role: FOLLOWER
I20260808 14:58:22.622078 31425 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0639c870a14aa9973ec9ee474312a6" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34005 } }
I20260808 14:58:22.622288 31425 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:58:22.622385 31425 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:58:22.622506 31425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:58:22.624518 31425 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0639c870a14aa9973ec9ee474312a6" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34005 } }
I20260808 14:58:22.624938 31425 leader_election.cc:302] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf0639c870a14aa9973ec9ee474312a6; no voters:
I20260808 14:58:22.625509 31425 leader_election.cc:288] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:58:22.625650 31430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:58:22.626955 31430 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [term 1 LEADER]: Becoming Leader. State: Replica: bf0639c870a14aa9973ec9ee474312a6, State: Running, Role: LEADER
I20260808 14:58:22.627511 31430 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0639c870a14aa9973ec9ee474312a6" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34005 } }
I20260808 14:58:22.627688 31425 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:58:22.630455 31431 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf0639c870a14aa9973ec9ee474312a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0639c870a14aa9973ec9ee474312a6" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34005 } } }
I20260808 14:58:22.630426 31432 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf0639c870a14aa9973ec9ee474312a6. Latest consensus state: current_term: 1 leader_uuid: "bf0639c870a14aa9973ec9ee474312a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0639c870a14aa9973ec9ee474312a6" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34005 } } }
I20260808 14:58:22.630865 31431 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:58:22.630865 31432 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:58:22.634718 31441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:58:22.639091 31441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:58:22.639976 31425 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:58:22.656338 31441 catalog_manager.cc:1347] Generated new cluster ID: 9a73966e67ab4155a2a0c08c04235812
I20260808 14:58:22.656595 31441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:58:22.677117 31441 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:58:22.679105 31441 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:58:22.688230 31441 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6: Generated new TSK 0
I20260808 14:58:22.689319 31441 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:58:23.489517 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.73.148:39545/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34005
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:58:23 dist-test-slave-z8x9 krb5kdc[30617](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786201103, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 14:58:23.977389 31491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:58:23.977905 31491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:58:23.978128 31491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:58:23.990115 31491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:58:23.990280 31491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:58:23.990535 31491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:58:24.004703 31491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.73.148:39545/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34005
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:58:24.006222 31491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:58:24.007579 31491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:58:24.023725 31507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:58:24.024883 31506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:58:24.031808 31491 server_base.cc:1034] running on GCE node
W20260808 14:58:24.033521 31512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:58:24.034591 31491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:58:24.037510 31491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:58:24.038823 31491 hybrid_clock.cc:648] HybridClock initialized: now 1786201104038740 us; error 68 us; skew 500 ppm
I20260808 14:58:24.039243 31491 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:58:24 dist-test-slave-z8x9 krb5kdc[30617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201104, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:58:24.043848 31491 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:58:24.049273 31491 webserver.cc:460] Webserver started at http://127.12.73.129:42787/ using document root <none> and password file <none>
I20260808 14:58:24.050316 31491 fs_manager.cc:359] Metadata directory not provided
I20260808 14:58:24.050472 31491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:58:24.050871 31491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:58:24 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201104, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:58:24.071487 31491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "d5d9e67d8ba54394be97691b9ea2b378"
format_stamp: "Formatted at 2026-08-08 14:58:24 on dist-test-slave-z8x9"
server_key: "4b879522cc372ac938e9d667b779a70f"
server_key_iv: "1ed63ac627fbb6e704ec37c2b325f59f"
server_key_version: "kuduclusterkey@0"
I20260808 14:58:24.073127 31491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "d5d9e67d8ba54394be97691b9ea2b378"
format_stamp: "Formatted at 2026-08-08 14:58:24 on dist-test-slave-z8x9"
server_key: "4b879522cc372ac938e9d667b779a70f"
server_key_iv: "1ed63ac627fbb6e704ec37c2b325f59f"
server_key_version: "kuduclusterkey@0"
I20260808 14:58:24.087399 31491 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.002s sys 0.010s
I20260808 14:58:24.116667 31527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:58:24.118717 31491 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260808 14:58:24.119007 31491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "d5d9e67d8ba54394be97691b9ea2b378"
format_stamp: "Formatted at 2026-08-08 14:58:24 on dist-test-slave-z8x9"
server_key: "4b879522cc372ac938e9d667b779a70f"
server_key_iv: "1ed63ac627fbb6e704ec37c2b325f59f"
server_key_version: "kuduclusterkey@0"
I20260808 14:58:24.119398 31491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:58:24.153553 31491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:58:24.158746 31491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:58:24.159134 31491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:58:24.161339 31491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:58:24.163070 31491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:58:24.163165 31491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:58:24.163331 31491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:58:24.163390 31491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:58:24 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201103, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:58:24.303674 31491 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:44641
I20260808 14:58:24.303745 31692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:44641 every 8 connection(s)
I20260808 14:58:24.305369 31491 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:58:24.307257 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 31491
I20260808 14:58:24.307468 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:58:24.308382 12582 external_mini_cluster.cc:1428] Setting key 61adbf08e61d00e312c3fc4d9d538d25
Aug 08 14:58:24 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201104, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:58:24.329524 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:24.310532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:43807 (local address 127.12.73.190:34005)
0808 14:58:24.313272 (+ 2740us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:24.313296 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:24.313318 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:58:24.313995 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:24.314000 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:24.314112 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:24.314235 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:58:24.315675 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:24.316466 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:24.318199 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:24.318630 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:24.318776 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:24.322496 (+ 3720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:58:24.322501 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:58:24.322504 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:58:24.322535 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:58:24.325486 (+ 2951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:24.326291 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:24.326299 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:24.326305 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:24.326473 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:24.327028 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:24.327036 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:24.327042 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:24.327448 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:58:24.327605 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:24.328596 (+ 991us) server_negotiation.cc:299] Negotiation successful
0808 14:58:24.328877 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2544,"thread_start_us":3526,"threads_started":1}
I20260808 14:58:24.330760 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:24.309153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34005 (local address 127.12.73.129:43807)
0808 14:58:24.310316 (+ 1163us) negotiation.cc:107] Waiting for socket to connect
0808 14:58:24.310398 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0808 14:58:24.313708 (+ 3310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:58:24.314497 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:58:24.314505 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:58:24.314950 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:58:24.315503 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:24.315520 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:24.316639 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:24.316645 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:24.318047 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:24.318059 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:24.318872 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:24.318880 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:24.319103 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:24.319847 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:58:24.319870 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:58:24.322256 (+ 2386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:58:24.325623 (+ 3367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:58:24.325632 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:58:24.325649 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:58:24.326154 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:58:24.326618 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:58:24.326623 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:58:24.326627 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:58:24.326885 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:58:24.327602 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:58:24.327611 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:58:24.328093 (+ 482us) client_negotiation.cc:769] Sending connection context
0808 14:58:24.328465 (+ 372us) client_negotiation.cc:240] Negotiation successful
0808 14:58:24.329106 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"thread_start_us":469,"threads_started":1}
I20260808 14:58:24.332913 31693 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34005
I20260808 14:58:24.333288 31693 heartbeater.cc:464] Registering TS with master...
I20260808 14:58:24.334249 31693 heartbeater.cc:511] Master 127.12.73.190:34005 requested a full tablet report, sending...
I20260808 14:58:24.336903 31375 ts_manager.cc:194] Registered new tserver with Master: d5d9e67d8ba54394be97691b9ea2b378 (127.12.73.129:44641)
I20260808 14:58:24.338982 31375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:43807
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:58:24.388935 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.73.148:39545/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34005
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:58:24 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201103, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
W20260808 14:58:24.924680 31704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:58:24.925056 31704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:58:24.925315 31704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:58:24.936887 31704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:58:24.937042 31704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:58:24.937330 31704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:58:24.952809 31704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.73.148:39545/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34005
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:58:24.954568 31704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:58:24.956349 31704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:58:24.972404 31721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:58:24.978003 31722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:58:24.981736 31725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:58:24.982069 31704 server_base.cc:1034] running on GCE node
I20260808 14:58:24.983116 31704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:58:24.984390 31704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:58:24.985694 31704 hybrid_clock.cc:648] HybridClock initialized: now 1786201104985577 us; error 100 us; skew 500 ppm
I20260808 14:58:24.986074 31704 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:58:24 dist-test-slave-z8x9 krb5kdc[30617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201104, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:58:24.990708 31704 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:58:24.992856 31704 webserver.cc:460] Webserver started at http://127.12.73.130:34167/ using document root <none> and password file <none>
I20260808 14:58:24.993821 31704 fs_manager.cc:359] Metadata directory not provided
I20260808 14:58:24.993959 31704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:58:24.994303 31704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:58:24 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201104, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:58:25.012532 31704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "1fdb49b88aa6485f963b2f51117f53ff"
format_stamp: "Formatted at 2026-08-08 14:58:25 on dist-test-slave-z8x9"
server_key: "0130c66f3517ff0ed4e9368bd7019d0d"
server_key_iv: "fc86475042b495613bd2069fa042b7e7"
server_key_version: "kuduclusterkey@0"
I20260808 14:58:25.013695 31704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "1fdb49b88aa6485f963b2f51117f53ff"
format_stamp: "Formatted at 2026-08-08 14:58:25 on dist-test-slave-z8x9"
server_key: "0130c66f3517ff0ed4e9368bd7019d0d"
server_key_iv: "fc86475042b495613bd2069fa042b7e7"
server_key_version: "kuduclusterkey@0"
I20260808 14:58:25.021193 31704 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.004s
I20260808 14:58:25.052927 31738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:58:25.055007 31704 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.002s sys 0.001s
I20260808 14:58:25.055305 31704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "1fdb49b88aa6485f963b2f51117f53ff"
format_stamp: "Formatted at 2026-08-08 14:58:25 on dist-test-slave-z8x9"
server_key: "0130c66f3517ff0ed4e9368bd7019d0d"
server_key_iv: "fc86475042b495613bd2069fa042b7e7"
server_key_version: "kuduclusterkey@0"
I20260808 14:58:25.055649 31704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:58:25.138087 31704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:58:25.143865 31704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:58:25.144310 31704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:58:25.151793 31704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:58:25.158059 31704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:58:25.158233 31704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:58:25.158412 31704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:58:25.158512 31704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:58:25.200177 31704 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:39585
I20260808 14:58:25.200186 31928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:39585 every 8 connection(s)
I20260808 14:58:25.201884 31704 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:58:25.207352 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 31704
I20260808 14:58:25.207532 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:58:25.208092 12582 external_mini_cluster.cc:1428] Setting key 2b1aec451f3dd524fec31ca1fd2bb727
Aug 08 14:58:25 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201104, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:58:25.224357 31932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.204680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:39659 (local address 127.12.73.190:34005)
0808 14:58:25.205218 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:25.205225 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:25.206271 (+ 1046us) server_negotiation.cc:407] Connection header received
0808 14:58:25.208743 (+ 2472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:25.208750 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:25.208848 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:25.208958 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:58:25.210989 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.211736 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.213425 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.213832 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.213968 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.217482 (+ 3514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:58:25.217487 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:58:25.217491 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:58:25.217522 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:58:25.220565 (+ 3043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:25.221397 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:25.221409 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:25.221412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:25.221542 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:25.222024 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:25.222028 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:25.222030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:25.222312 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:58:25.222482 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:25.223583 (+ 1101us) server_negotiation.cc:299] Negotiation successful
0808 14:58:25.223874 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":271,"threads_started":1}
I20260808 14:58:25.226290 31933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.205344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34005 (local address 127.12.73.130:39659)
0808 14:58:25.206089 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0808 14:58:25.206145 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:58:25.208399 (+ 2254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:58:25.209521 (+ 1122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:58:25.209532 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:58:25.210199 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:58:25.210818 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.210836 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.211905 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.211910 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.213266 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.213286 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.214079 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.214087 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.214328 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.215057 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:58:25.215083 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:58:25.217258 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:58:25.220741 (+ 3483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:58:25.220750 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:58:25.220766 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:58:25.221259 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:58:25.221673 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:58:25.221680 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:58:25.221684 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:58:25.221889 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:58:25.222449 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:58:25.222458 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:58:25.222864 (+ 406us) client_negotiation.cc:769] Sending connection context
0808 14:58:25.223438 (+ 574us) client_negotiation.cc:240] Negotiation successful
0808 14:58:25.224219 (+ 781us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":310,"threads_started":1}
I20260808 14:58:25.228102 31929 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34005
I20260808 14:58:25.228421 31929 heartbeater.cc:464] Registering TS with master...
I20260808 14:58:25.229395 31929 heartbeater.cc:511] Master 127.12.73.190:34005 requested a full tablet report, sending...
I20260808 14:58:25.231267 31375 ts_manager.cc:194] Registered new tserver with Master: 1fdb49b88aa6485f963b2f51117f53ff (127.12.73.130:39585)
I20260808 14:58:25.232414 31375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:39659
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:58:25.280448 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.73.148:39545/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34005
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:58:25.343361 31693 heartbeater.cc:503] Master 127.12.73.190:34005 was elected leader, sending a full tablet report...
W20260808 14:58:25.634948 31937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:58:25.635206 31937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:58:25.635371 31937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:58:25.642501 31937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:58:25.642602 31937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:58:25.642807 31937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:58:25.652742 31937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.73.148:39545/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34005
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:58:25.654047 31937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:58:25.655316 31937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:58:25.668241 31942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:58:25.668339 31944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:58:25.668380 31949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:58:25.669431 31937 server_base.cc:1034] running on GCE node
I20260808 14:58:25.670028 31937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:58:25.670907 31937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:58:25.672133 31937 hybrid_clock.cc:648] HybridClock initialized: now 1786201105672104 us; error 49 us; skew 500 ppm
I20260808 14:58:25.672446 31937 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:58:25 dist-test-slave-z8x9 krb5kdc[30617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201105, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:58:25.675707 31937 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:58:25.677134 31937 webserver.cc:460] Webserver started at http://127.12.73.131:44001/ using document root <none> and password file <none>
I20260808 14:58:25.677856 31937 fs_manager.cc:359] Metadata directory not provided
I20260808 14:58:25.678005 31937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:58:25.678320 31937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:58:25 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201105, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:58:25.693109 31937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "218847d89b05476fab7e7a2953621151"
format_stamp: "Formatted at 2026-08-08 14:58:25 on dist-test-slave-z8x9"
server_key: "a4de7404c915a244314b5c8fed2dddd0"
server_key_iv: "17c4bf408183ad3e7e851a9109febfd1"
server_key_version: "kuduclusterkey@0"
I20260808 14:58:25.694016 31937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "218847d89b05476fab7e7a2953621151"
format_stamp: "Formatted at 2026-08-08 14:58:25 on dist-test-slave-z8x9"
server_key: "a4de7404c915a244314b5c8fed2dddd0"
server_key_iv: "17c4bf408183ad3e7e851a9109febfd1"
server_key_version: "kuduclusterkey@0"
I20260808 14:58:25.699412 31937 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:58:25.716501 31957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:58:25.718272 31937 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 14:58:25.718463 31937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "218847d89b05476fab7e7a2953621151"
format_stamp: "Formatted at 2026-08-08 14:58:25 on dist-test-slave-z8x9"
server_key: "a4de7404c915a244314b5c8fed2dddd0"
server_key_iv: "17c4bf408183ad3e7e851a9109febfd1"
server_key_version: "kuduclusterkey@0"
I20260808 14:58:25.718729 31937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:58:25.750304 31937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:58:25.753953 31937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:58:25.754218 31937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:58:25.755100 31937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:58:25.756404 31937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:58:25.756479 31937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:58:25.756568 31937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:58:25.756618 31937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:58:25.789785 31937 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:43217
I20260808 14:58:25.789825 32118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:43217 every 8 connection(s)
I20260808 14:58:25.791043 31937 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:58:25.791894 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 31937
I20260808 14:58:25.792104 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:58:25.792627 12582 external_mini_cluster.cc:1428] Setting key 8ef45e2ee33f886e1b6176a5c707f7fa
Aug 08 14:58:25 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201105, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:58:25.811282 32121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.793900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:53141 (local address 127.12.73.190:34005)
0808 14:58:25.794477 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:25.794483 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:25.795822 (+ 1339us) server_negotiation.cc:407] Connection header received
0808 14:58:25.797654 (+ 1832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:25.797658 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:25.797740 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:25.797832 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:58:25.799398 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.800171 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.801774 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.802236 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.802330 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.805619 (+ 3289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:58:25.805624 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:58:25.805627 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:58:25.805666 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:58:25.808614 (+ 2948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:25.809346 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:25.809351 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:25.809353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:25.809475 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:25.809902 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:25.809905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:25.809907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:25.810155 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:58:25.810271 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:25.810867 (+ 596us) server_negotiation.cc:299] Negotiation successful
0808 14:58:25.811032 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":322,"threads_started":1}
I20260808 14:58:25.812165 32123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.794663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34005 (local address 127.12.73.131:53141)
0808 14:58:25.795662 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0808 14:58:25.795713 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:58:25.797423 (+ 1710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:58:25.798035 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:58:25.798043 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:58:25.798585 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:58:25.799173 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.799191 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.800310 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.800314 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.801638 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.801650 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.802438 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.802443 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.802632 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.803286 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:58:25.803307 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:58:25.805429 (+ 2122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:58:25.808734 (+ 3305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:58:25.808740 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:58:25.808751 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:58:25.809218 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:58:25.809568 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:58:25.809571 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:58:25.809574 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:58:25.809801 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:58:25.810265 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:58:25.810270 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:58:25.810556 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 14:58:25.810769 (+ 213us) client_negotiation.cc:240] Negotiation successful
0808 14:58:25.811119 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"thread_start_us":436,"threads_started":1}
I20260808 14:58:25.813553 32119 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34005
I20260808 14:58:25.813889 32119 heartbeater.cc:464] Registering TS with master...
I20260808 14:58:25.814592 32119 heartbeater.cc:511] Master 127.12.73.190:34005 requested a full tablet report, sending...
I20260808 14:58:25.815974 31375 ts_manager.cc:194] Registered new tserver with Master: 218847d89b05476fab7e7a2953621151 (127.12.73.131:43217)
I20260808 14:58:25.816784 31375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:53141
I20260808 14:58:25.820366 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:58:25.838689 32121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.825251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47542 (local address 127.12.73.190:34005)
0808 14:58:25.825467 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:25.825476 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:25.826084 (+ 608us) server_negotiation.cc:407] Connection header received
0808 14:58:25.826314 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:25.826318 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:25.826394 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:25.826482 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:58:25.828118 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.828971 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.830325 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.830730 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.830823 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.833126 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:58:25.833130 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:58:25.833133 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:58:25.833251 (+ 118us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:58:25.835930 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:25.836595 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:25.836599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:25.836601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:25.836730 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:25.837272 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:25.837281 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:25.837283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:25.837795 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:58:25.837985 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:25.838296 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 14:58:25.838478 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:58:25.842568 31375 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:58:25.850015 31375 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:58:25.875429 32148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.867112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45194 (local address 127.12.73.131:43217)
0808 14:58:25.868279 (+ 1167us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:25.868286 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:25.868317 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:58:25.868404 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:25.868410 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:25.868623 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:25.868868 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:58:25.869525 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.870624 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.873262 (+ 2638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.874173 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.874323 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.874561 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:25.874845 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 14:58:25.875003 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":980,"thread_start_us":809,"threads_started":1}
I20260808 14:58:25.875459 32147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.866468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:43217 (local address 127.0.0.1:45194)
0808 14:58:25.867541 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0808 14:58:25.867565 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:58:25.867700 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:58:25.868859 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:58:25.868864 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:58:25.868888 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:58:25.869328 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.869338 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.870813 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.870818 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.873079 (+ 2261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.873092 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.874368 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.874375 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.874561 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.874618 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 14:58:25.874800 (+ 182us) client_negotiation.cc:240] Negotiation successful
0808 14:58:25.874989 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":925,"mutex_wait_us":31,"thread_start_us":919,"threads_started":1}
I20260808 14:58:25.875710 32146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.864698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38382 (local address 127.12.73.129:44641)
0808 14:58:25.866701 (+ 2003us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:25.866711 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:25.867513 (+ 802us) server_negotiation.cc:407] Connection header received
0808 14:58:25.867622 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:25.867629 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:25.867858 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:25.868053 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:58:25.868852 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.870404 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.872860 (+ 2456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.874278 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.874408 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.874634 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:25.875157 (+ 523us) server_negotiation.cc:299] Negotiation successful
0808 14:58:25.875304 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1819,"thread_start_us":2874,"threads_started":1}
I20260808 14:58:25.876472 32144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.864026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44641 (local address 127.0.0.1:38382)
0808 14:58:25.867156 (+ 3130us) negotiation.cc:107] Waiting for socket to connect
0808 14:58:25.867188 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 14:58:25.867353 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:58:25.868161 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:58:25.868166 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:58:25.868191 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:58:25.868656 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.868668 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.870514 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.870520 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.872701 (+ 2181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.872713 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.874790 (+ 2077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.874799 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.874981 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.875012 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 14:58:25.875103 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:58:25.875229 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2996,"mutex_wait_us":30,"thread_start_us":2839,"threads_started":1}
I20260808 14:58:25.876961 32142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.863729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:39585 (local address 127.0.0.1:33398)
0808 14:58:25.864668 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0808 14:58:25.864727 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 14:58:25.864936 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:58:25.867056 (+ 2120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:58:25.867065 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:58:25.867107 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:58:25.868257 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.868275 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.870397 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.870403 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.873030 (+ 2627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.873047 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.876128 (+ 3081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.876133 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.876287 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.876325 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:58:25.876441 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 14:58:25.876566 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"mutex_wait_us":97,"thread_start_us":416,"threads_started":1}
I20260808 14:58:25.876994 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.864069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33398 (local address 127.12.73.130:39585)
0808 14:58:25.865464 (+ 1395us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:25.865477 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:25.865516 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:58:25.866083 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:25.866095 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:25.866411 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:25.866639 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:58:25.868519 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.870245 (+ 1726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.873245 (+ 3000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.874718 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.874852 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.875024 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:25.876494 (+ 1470us) server_negotiation.cc:299] Negotiation successful
0808 14:58:25.876640 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1195,"thread_start_us":1063,"threads_started":1}
I20260808 14:58:25.881400 31597 tablet_service.cc:1467] Processing CreateTablet for tablet 7ce9ec60f39e462897808b91e3d12fb1 (DEFAULT_TABLE table=test-table [id=6db66bcc9a164396b421c57e212daca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:58:25.881152 31822 tablet_service.cc:1467] Processing CreateTablet for tablet 7ce9ec60f39e462897808b91e3d12fb1 (DEFAULT_TABLE table=test-table [id=6db66bcc9a164396b421c57e212daca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:58:25.881335 32029 tablet_service.cc:1467] Processing CreateTablet for tablet 7ce9ec60f39e462897808b91e3d12fb1 (DEFAULT_TABLE table=test-table [id=6db66bcc9a164396b421c57e212daca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:58:25.882674 31597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ce9ec60f39e462897808b91e3d12fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:58:25.882696 32029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ce9ec60f39e462897808b91e3d12fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:58:25.882704 31822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ce9ec60f39e462897808b91e3d12fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:58:25.895183 32149 tablet_bootstrap.cc:492] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff: Bootstrap starting.
I20260808 14:58:25.897113 32150 tablet_bootstrap.cc:492] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378: Bootstrap starting.
I20260808 14:58:25.898576 32151 tablet_bootstrap.cc:492] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151: Bootstrap starting.
I20260808 14:58:25.899085 32149 tablet_bootstrap.cc:654] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff: Neither blocks nor log segments found. Creating new log.
I20260808 14:58:25.900516 32149 log.cc:824] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff: Log is configured to *not* fsync() on all Append() calls
I20260808 14:58:25.901204 32150 tablet_bootstrap.cc:654] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378: Neither blocks nor log segments found. Creating new log.
I20260808 14:58:25.901786 32151 tablet_bootstrap.cc:654] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151: Neither blocks nor log segments found. Creating new log.
I20260808 14:58:25.902501 32150 log.cc:824] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378: Log is configured to *not* fsync() on all Append() calls
I20260808 14:58:25.903055 32151 log.cc:824] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151: Log is configured to *not* fsync() on all Append() calls
I20260808 14:58:25.904043 32149 tablet_bootstrap.cc:492] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff: No bootstrap required, opened a new log
I20260808 14:58:25.904361 32149 ts_tablet_manager.cc:1397] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260808 14:58:25.905505 32150 tablet_bootstrap.cc:492] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378: No bootstrap required, opened a new log
I20260808 14:58:25.905769 32150 ts_tablet_manager.cc:1397] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 14:58:25.906499 32151 tablet_bootstrap.cc:492] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151: No bootstrap required, opened a new log
I20260808 14:58:25.906760 32151 ts_tablet_manager.cc:1397] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 14:58:25.912566 32150 raft_consensus.cc:348] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdb49b88aa6485f963b2f51117f53ff" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39585 } } peers { permanent_uuid: "d5d9e67d8ba54394be97691b9ea2b378" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44641 } } peers { permanent_uuid: "218847d89b05476fab7e7a2953621151" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43217 } }
I20260808 14:58:25.913141 32150 raft_consensus.cc:374] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:58:25.913352 32150 raft_consensus.cc:729] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5d9e67d8ba54394be97691b9ea2b378, State: Initialized, Role: FOLLOWER
I20260808 14:58:25.914076 32150 consensus_queue.cc:260] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdb49b88aa6485f963b2f51117f53ff" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39585 } } peers { permanent_uuid: "d5d9e67d8ba54394be97691b9ea2b378" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44641 } } peers { permanent_uuid: "218847d89b05476fab7e7a2953621151" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43217 } }
I20260808 14:58:25.914952 32149 raft_consensus.cc:348] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdb49b88aa6485f963b2f51117f53ff" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39585 } } peers { permanent_uuid: "d5d9e67d8ba54394be97691b9ea2b378" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44641 } } peers { permanent_uuid: "218847d89b05476fab7e7a2953621151" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43217 } }
I20260808 14:58:25.915408 32149 raft_consensus.cc:374] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:58:25.915555 32149 raft_consensus.cc:729] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fdb49b88aa6485f963b2f51117f53ff, State: Initialized, Role: FOLLOWER
I20260808 14:58:25.915817 32150 ts_tablet_manager.cc:1428] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378: Time spent starting tablet: real 0.010s user 0.006s sys 0.003s
I20260808 14:58:25.916292 32149 consensus_queue.cc:260] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdb49b88aa6485f963b2f51117f53ff" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39585 } } peers { permanent_uuid: "d5d9e67d8ba54394be97691b9ea2b378" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44641 } } peers { permanent_uuid: "218847d89b05476fab7e7a2953621151" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43217 } }
I20260808 14:58:25.917522 31929 heartbeater.cc:503] Master 127.12.73.190:34005 was elected leader, sending a full tablet report...
I20260808 14:58:25.918210 32149 ts_tablet_manager.cc:1428] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260808 14:58:25.918428 32151 raft_consensus.cc:348] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdb49b88aa6485f963b2f51117f53ff" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39585 } } peers { permanent_uuid: "d5d9e67d8ba54394be97691b9ea2b378" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44641 } } peers { permanent_uuid: "218847d89b05476fab7e7a2953621151" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43217 } }
I20260808 14:58:25.918915 32151 raft_consensus.cc:374] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:58:25.919030 32151 raft_consensus.cc:729] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218847d89b05476fab7e7a2953621151, State: Initialized, Role: FOLLOWER
I20260808 14:58:25.919596 32151 consensus_queue.cc:260] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdb49b88aa6485f963b2f51117f53ff" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39585 } } peers { permanent_uuid: "d5d9e67d8ba54394be97691b9ea2b378" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44641 } } peers { permanent_uuid: "218847d89b05476fab7e7a2953621151" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43217 } }
I20260808 14:58:25.920745 32119 heartbeater.cc:503] Master 127.12.73.190:34005 was elected leader, sending a full tablet report...
I20260808 14:58:25.921404 32151 ts_tablet_manager.cc:1428] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
W20260808 14:58:25.954113 31930 tablet.cc:2369] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:58:25.988234 32160 raft_consensus.cc:482] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:58:25.988586 32160 raft_consensus.cc:504] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdb49b88aa6485f963b2f51117f53ff" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39585 } } peers { permanent_uuid: "d5d9e67d8ba54394be97691b9ea2b378" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44641 } } peers { permanent_uuid: "218847d89b05476fab7e7a2953621151" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43217 } }
I20260808 14:58:25.990286 32160 leader_election.cc:288] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fdb49b88aa6485f963b2f51117f53ff (127.12.73.130:39585), d5d9e67d8ba54394be97691b9ea2b378 (127.12.73.129:44641)
I20260808 14:58:25.996986 32146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.990819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:48141 (local address 127.12.73.129:44641)
0808 14:58:25.991009 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:25.991015 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:25.991064 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:58:25.991321 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:25.991325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:25.991385 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:25.991483 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:58:25.991920 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.993012 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.994970 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.996114 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.996241 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.996295 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:25.996673 (+ 378us) server_negotiation.cc:299] Negotiation successful
0808 14:58:25.996764 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:58:25.997084 32123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.990792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44641 (local address 127.12.73.131:48141)
0808 14:58:25.990988 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 14:58:25.991009 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:58:25.991148 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:58:25.991513 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:58:25.991521 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:58:25.991548 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:58:25.991746 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.991756 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.993155 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.993160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.994812 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.994824 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.996290 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.996297 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.996498 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.996535 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 14:58:25.996648 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 14:58:25.996788 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":1}
I20260808 14:58:25.997922 32161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.990790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:39585 (local address 127.12.73.131:35717)
0808 14:58:25.991739 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0808 14:58:25.991758 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:58:25.991899 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:58:25.992210 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:58:25.992216 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:58:25.992242 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:58:25.992627 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.992638 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.993994 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.993998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.995675 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:58:25.995689 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.997098 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.997109 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:58:25.997325 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.997362 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 14:58:25.997462 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 14:58:25.997589 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"mutex_wait_us":223,"thread_start_us":395,"threads_started":1}
I20260808 14:58:25.998178 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:25.990761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:35717 (local address 127.12.73.130:39585)
0808 14:58:25.991009 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:25.991018 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:25.991856 (+ 838us) server_negotiation.cc:407] Connection header received
0808 14:58:25.992027 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:25.992030 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:25.992088 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:25.992155 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:58:25.992800 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.993837 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.995823 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:25.996869 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:25.997008 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:25.997079 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:25.997813 (+ 734us) server_negotiation.cc:299] Negotiation successful
0808 14:58:25.997909 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 14:58:25.998412 31629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ce9ec60f39e462897808b91e3d12fb1" candidate_uuid: "218847d89b05476fab7e7a2953621151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d9e67d8ba54394be97691b9ea2b378" is_pre_election: true
I20260808 14:58:25.999055 31629 raft_consensus.cc:2454] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218847d89b05476fab7e7a2953621151 in term 0.
I20260808 14:58:25.999089 31863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ce9ec60f39e462897808b91e3d12fb1" candidate_uuid: "218847d89b05476fab7e7a2953621151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdb49b88aa6485f963b2f51117f53ff" is_pre_election: true
I20260808 14:58:25.999646 31863 raft_consensus.cc:2454] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218847d89b05476fab7e7a2953621151 in term 0.
I20260808 14:58:25.999800 31958 leader_election.cc:302] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218847d89b05476fab7e7a2953621151, d5d9e67d8ba54394be97691b9ea2b378; no voters:
I20260808 14:58:26.000291 32160 raft_consensus.cc:2781] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:58:26.000440 32160 raft_consensus.cc:482] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:58:26.000542 32160 raft_consensus.cc:3037] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:58:26.003044 32160 raft_consensus.cc:504] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdb49b88aa6485f963b2f51117f53ff" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39585 } } peers { permanent_uuid: "d5d9e67d8ba54394be97691b9ea2b378" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44641 } } peers { permanent_uuid: "218847d89b05476fab7e7a2953621151" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43217 } }
I20260808 14:58:26.003679 32160 leader_election.cc:288] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [CANDIDATE]: Term 1 election: Requested vote from peers 1fdb49b88aa6485f963b2f51117f53ff (127.12.73.130:39585), d5d9e67d8ba54394be97691b9ea2b378 (127.12.73.129:44641)
I20260808 14:58:26.004179 31629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ce9ec60f39e462897808b91e3d12fb1" candidate_uuid: "218847d89b05476fab7e7a2953621151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5d9e67d8ba54394be97691b9ea2b378"
I20260808 14:58:26.004176 31863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ce9ec60f39e462897808b91e3d12fb1" candidate_uuid: "218847d89b05476fab7e7a2953621151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdb49b88aa6485f963b2f51117f53ff"
I20260808 14:58:26.004400 31863 raft_consensus.cc:3037] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:58:26.004408 31629 raft_consensus.cc:3037] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:58:26.006732 31629 raft_consensus.cc:2454] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218847d89b05476fab7e7a2953621151 in term 1.
I20260808 14:58:26.006836 31863 raft_consensus.cc:2454] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218847d89b05476fab7e7a2953621151 in term 1.
I20260808 14:58:26.007189 31958 leader_election.cc:302] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218847d89b05476fab7e7a2953621151, d5d9e67d8ba54394be97691b9ea2b378; no voters:
I20260808 14:58:26.007503 32160 raft_consensus.cc:2781] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:58:26.007973 32160 raft_consensus.cc:686] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 1 LEADER]: Becoming Leader. State: Replica: 218847d89b05476fab7e7a2953621151, State: Running, Role: LEADER
I20260808 14:58:26.008533 32160 consensus_queue.cc:237] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdb49b88aa6485f963b2f51117f53ff" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39585 } } peers { permanent_uuid: "d5d9e67d8ba54394be97691b9ea2b378" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44641 } } peers { permanent_uuid: "218847d89b05476fab7e7a2953621151" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43217 } }
I20260808 14:58:26.013240 31375 catalog_manager.cc:5495] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 reported cstate change: term changed from 0 to 1, leader changed from <none> to 218847d89b05476fab7e7a2953621151 (127.12.73.131). New cstate: current_term: 1 leader_uuid: "218847d89b05476fab7e7a2953621151" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdb49b88aa6485f963b2f51117f53ff" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5d9e67d8ba54394be97691b9ea2b378" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218847d89b05476fab7e7a2953621151" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43217 } health_report { overall_health: HEALTHY } } }
W20260808 14:58:26.042851 32120 tablet.cc:2369] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:58:26.064258 31696 tablet.cc:2369] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:58:26.065567 32148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:26.060132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45196 (local address 127.12.73.131:43217)
0808 14:58:26.060328 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:26.060332 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:26.060348 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:58:26.060434 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:26.060437 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:26.060518 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:26.060640 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:58:26.060959 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:26.061785 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:26.063308 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:26.063741 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:26.063835 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:26.064323 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:58:26.065020 (+ 697us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:58:26.065207 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:26.065308 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 14:58:26.065373 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 14:58:26.073477 31629 raft_consensus.cc:1261] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378 [term 1 FOLLOWER]: Refusing update from remote peer 218847d89b05476fab7e7a2953621151: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:58:26.073498 31863 raft_consensus.cc:1261] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff [term 1 FOLLOWER]: Refusing update from remote peer 218847d89b05476fab7e7a2953621151: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:58:26.074435 32162 consensus_queue.cc:1035] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5d9e67d8ba54394be97691b9ea2b378" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:58:26.074791 32160 consensus_queue.cc:1035] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdb49b88aa6485f963b2f51117f53ff" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:58:26.099479 31375 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:58:26.099897 31375 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:58:26.104698 31375 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf0639c870a14aa9973ec9ee474312a6: Sending DeleteTablet for 3 replicas of tablet 7ce9ec60f39e462897808b91e3d12fb1
I20260808 14:58:26.106307 31822 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ce9ec60f39e462897808b91e3d12fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:58:26 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:33398
I20260808 14:58:26.110054 31597 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ce9ec60f39e462897808b91e3d12fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:58:26 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:38382
I20260808 14:58:26.111567 32189 tablet_replica.cc:330] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378: stopping tablet replica
I20260808 14:58:26.112128 32189 raft_consensus.cc:2229] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:58:26.112136 32029 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ce9ec60f39e462897808b91e3d12fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:58:26 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:45194
I20260808 14:58:26.113240 32189 raft_consensus.cc:2258] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:58:26.114020 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 31491
I20260808 14:58:26.118398 32189 ts_tablet_manager.cc:1905] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:58:26.125851 32190 tablet_replica.cc:330] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151: stopping tablet replica
I20260808 14:58:26.126240 32190 raft_consensus.cc:2229] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:58:26.135428 32189 ts_tablet_manager.cc:1918] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:58:26.135614 32188 tablet_replica.cc:330] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff: stopping tablet replica
I20260808 14:58:26.135718 32189 log.cc:1196] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/7ce9ec60f39e462897808b91e3d12fb1
I20260808 14:58:26.136519 32189 ts_tablet_manager.cc:1939] T 7ce9ec60f39e462897808b91e3d12fb1 P d5d9e67d8ba54394be97691b9ea2b378: Deleting consensus metadata
I20260808 14:58:26.137059 32188 raft_consensus.cc:2229] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:58:26.138875 32188 raft_consensus.cc:2258] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:58:26.138983 31344 catalog_manager.cc:4841] TS d5d9e67d8ba54394be97691b9ea2b378 (127.12.73.129:44641): tablet 7ce9ec60f39e462897808b91e3d12fb1 (table test-table [id=6db66bcc9a164396b421c57e212daca8]) successfully deleted
I20260808 14:58:26.139968 32190 raft_consensus.cc:2258] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:58:26.141780 32188 ts_tablet_manager.cc:1905] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:58:26.141887 32190 ts_tablet_manager.cc:1905] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 14:58:26 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:58:26.149061 32188 ts_tablet_manager.cc:1918] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:58:26.149067 32190 ts_tablet_manager.cc:1918] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:58:26.149263 32188 log.cc:1196] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/7ce9ec60f39e462897808b91e3d12fb1
I20260808 14:58:26.149398 32190 log.cc:1196] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/7ce9ec60f39e462897808b91e3d12fb1
I20260808 14:58:26.149928 32188 ts_tablet_manager.cc:1939] T 7ce9ec60f39e462897808b91e3d12fb1 P 1fdb49b88aa6485f963b2f51117f53ff: Deleting consensus metadata
I20260808 14:58:26.150009 32190 ts_tablet_manager.cc:1939] T 7ce9ec60f39e462897808b91e3d12fb1 P 218847d89b05476fab7e7a2953621151: Deleting consensus metadata
I20260808 14:58:26.151765 31345 catalog_manager.cc:4841] TS 218847d89b05476fab7e7a2953621151 (127.12.73.131:43217): tablet 7ce9ec60f39e462897808b91e3d12fb1 (table test-table [id=6db66bcc9a164396b421c57e212daca8]) successfully deleted
I20260808 14:58:26.152101 31346 catalog_manager.cc:4841] TS 1fdb49b88aa6485f963b2f51117f53ff (127.12.73.130:39585): tablet 7ce9ec60f39e462897808b91e3d12fb1 (table test-table [id=6db66bcc9a164396b421c57e212daca8]) successfully deleted
I20260808 14:58:26.157024 32146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:26.115638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38392 (local address 127.12.73.129:44641)
0808 14:58:26.115824 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:26.115833 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:26.134375 (+ 18542us) server_negotiation.cc:407] Connection header received
0808 14:58:26.134655 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:26.134661 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:26.134748 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:26.134846 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:58:26.139550 (+ 4704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:26.140651 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:26.142955 (+ 2304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:26.143611 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:26.143711 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:26.149680 (+ 5969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:58:26.149697 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:58:26.149717 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:58:26.149773 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:58:26.154041 (+ 4268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:26.154831 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:26.154840 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:26.154843 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:26.155019 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:26.155390 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:26.155395 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:26.155399 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:26.155893 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:58:26.156220 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:26.156393 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 14:58:26.156628 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:58:26.157752 31683 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:58:26.279183 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 31491
I20260808 14:58:26.307019 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 31704
Aug 08 14:58:26 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:58:26.324616 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:26.307931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33406 (local address 127.12.73.130:39585)
0808 14:58:26.308139 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:26.308146 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:26.308167 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:58:26.308244 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:26.308250 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:26.308332 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:26.308448 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:58:26.309878 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:26.311057 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:26.312315 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:26.312993 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:26.313121 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:26.317585 (+ 4464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:58:26.317604 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:58:26.317625 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:58:26.317667 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:58:26.321568 (+ 3901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:26.322286 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:26.322296 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:26.322300 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:26.322456 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:26.322814 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:26.322819 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:26.322823 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:26.323281 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:58:26.323572 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:26.323999 (+ 427us) server_negotiation.cc:299] Negotiation successful
0808 14:58:26.324236 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:58:26.325459 31923 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:58:26.419179 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 31704
I20260808 14:58:26.451740 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 31937
Aug 08 14:58:26 dist-test-slave-z8x9 krb5kdc[30617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:58:26.470283 32148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:58:26.452564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45200 (local address 127.12.73.131:43217)
0808 14:58:26.452733 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 14:58:26.452738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:58:26.452808 (+ 70us) server_negotiation.cc:407] Connection header received
0808 14:58:26.452995 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:58:26.452999 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:58:26.453062 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:58:26.453219 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:58:26.455162 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:26.455993 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:26.458074 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:58:26.458503 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:58:26.458602 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:58:26.464134 (+ 5532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:58:26.464146 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:58:26.464162 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:58:26.464203 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:58:26.467395 (+ 3192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:26.468136 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:26.468143 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:26.468145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:26.468292 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:58:26.468684 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:58:26.468688 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:58:26.468690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:58:26.469033 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:58:26.469378 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 14:58:26.469717 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 14:58:26.469948 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:58:26.471020 32114 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:58:26.596879 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 31937
I20260808 14:58:26.627792 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 31321
I20260808 14:58:26.629094 31418 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:58:26.745859 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 31321
I20260808 14:58:26.777714 12582 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 14:58:27.123390 12582 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 14:58:27.123667 12582 mini_ranger.cc:66] Stopping Ranger...
I20260808 14:58:27.469506 12582 mini_ranger.cc:68] Stopped Ranger
2026-08-08 14:58:27.469 UTC [30669] LOG: received smart shutdown request
2026-08-08 14:58:27.473 UTC [30669] LOG: background worker "logical replication launcher" (PID 30682) exited with exit code 1
2026-08-08 14:58:27.474 UTC [30674] LOG: shutting down
2026-08-08 14:58:27.642 UTC [30669] LOG: database system is shut down
2026-08-08T14:58:27Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50520 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:58:27 dist-test-slave-z8x9 krb5kdc[32214](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:58:27 dist-test-slave-z8x9 krb5kdc[32214](info): set up 2 sockets
Aug 08 14:58:27 dist-test-slave-z8x9 krb5kdc[32214](info): commencing operation
krb5kdc: starting...
W20260808 14:58:29.132743 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:58:29 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:58:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:58:29Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.73.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.73.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/rangeradmin_127.12.73.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/rangeradmin_127.12.73.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.73.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.73.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/rangerlookup_127.12.73.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/rangerlookup_127.12.73.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.73.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.73.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/HTTP_127.12.73.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/HTTP_127.12.73.148@KRBTEST.COM.keytab.
I20260808 14:58:29.514202 12582 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasktuKHj1/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/postgres -l logfile start
2026-08-08 14:58:32.023 UTC [32253] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 14:58:32.023 UTC [32253] LOG: listening on IPv4 address "127.12.73.148", port 48745
2026-08-08 14:58:32.026 UTC [32253] LOG: listening on Unix socket "/tmp/.s.PGSQL.48745"
2026-08-08 14:58:32.050 UTC [32257] LOG: database system was shut down at 2026-08-08 14:58:30 UTC
2026-08-08 14:58:32.053 UTC [32253] LOG: database system is ready to accept connections
I20260808 14:58:33.257112 12582 mini_postgres.cc:96] Postgres bound to 48745
2026-08-08 14:58:33.281 UTC [32268] FATAL: database "slave" does not exist
127.12.73.148:48745 - accepting connections
I20260808 14:58:33.282440 12582 mini_ranger.cc:161] Starting Ranger...
I20260808 14:58:33.313525 12582 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 14:58:33.787669 12582 mini_ranger.cc:87] Created ranger Postgres database
I20260808 14:58:33.787802 12582 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-admin
2026-08-08 14:58:34,092 [I] DB FLAVOR :POSTGRES
2026-08-08 14:58:34,092 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:58:34,092 [I] Checking connection..
2026-08-08 14:58:34,092 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 14:58:34,360 [I] Checking connection passed.
2026-08-08 14:58:34,360 [I] --------- Verifying version history table ---------
2026-08-08 14:58:34,360 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:58:34,617 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:58:34,618 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:58:34,892 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:58:34,892 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 14:58:34,892 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 14:58:35.151 UTC [32366] WARNING: there is no transaction in progress
2026-08-08 14:58:35,158 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 14:58:35,159 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:58:35,423 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 14:58:35,424 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:58:35,424 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 14:58:35,689 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 14:58:35,953 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-z8x9.c.gcp-upstream.internal','N') ;"
2026-08-08 14:58:36,211 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:58:36,465 [I] Table x_portal_user does not exist in database ranger
2026-08-08 14:58:36,465 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:58:36,721 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 14:58:36,721 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:58:36,953 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:58:37,209 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 14:58:37,210 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 14:58:38.170 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.186 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.202 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.218 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.234 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.255 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.309 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.315 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.330 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.341 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.351 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.365 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.375 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.382 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.388 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:38.394 UTC [32553] WARNING: there is no transaction in progress
2026-08-08 14:58:39,024 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 14:58:39,024 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 14:58:39,267 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 14:58:39,267 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:58:39,520 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 14:58:39,521 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:58:39,787 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 14:58:39,787 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:58:40,054 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:58:40,316 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-z8x9.c.gcp-upstream.internal';"
2026-08-08 14:58:40,578 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 14:58:40,578 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 14:58:40,823 [I] DB_PATCHES have already been applied
I20260808 14:58:40.829871 12582 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-admin:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasktuKHj1/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 14:58:40.829988 12582 mini_ranger.cc:193] Using host: 127.12.73.148
I20260808 14:58:40.850440 12582 mini_ranger.cc:227] Ranger admin URL: http://127.12.73.148:60085
Aug 08, 2026 2:58:41 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:58:41 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:58:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:58:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:58:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:58:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:58:41 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 14:58:42.307763 12582 mini_ranger.cc:160] Time spent starting Ranger: real 9.025s user 0.005s sys 0.052s
Aug 08, 2026 2:59:01 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:59:01 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 2:59:01 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:59:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:59:01 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:59:02 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 14:59:02.746942 12582 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.73.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.73.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/rangerkms_127.12.73.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.73.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/rangerkms_127.12.73.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.73.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.73.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.73.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/HTTP_127.12.73.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.73.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/HTTP_127.12.73.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 14:59:02 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201142, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 14:59:02.948124 12582 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 14:59:02.974125 12582 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 14:59:03.789614 12582 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 14:59:03.789757 12582 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-kms
I20260808 14:59:03.789809 12582 mini_ranger_kms.cc:227] Using postgres at 127.12.73.148:48745
2026-08-08 14:59:04,169 [I] DB FLAVOR :POSTGRES
2026-08-08 14:59:04,169 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:59:04,170 [I] Checking connection
2026-08-08 14:59:04,170 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 14:59:04,410 [I] connection success
2026-08-08 14:59:04,410 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 14:59:04,411 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 14:59:04,411 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 14:59:04,642 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 14:59:04,642 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:59:04,643 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 14:59:04,643 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.73.148:48745/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 14:59:04,901 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 14:59:05.366742 12582 mini_ranger_kms.cc:310] Created kms service
I20260808 14:59:05.540827 12582 mini_ranger_kms.cc:326] Created kudu user
I20260808 14:59:05.587365 12582 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 14:59:05 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201142, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:59:05.994325 12582 mini_ranger_kms.cc:384] Added ranger policy
I20260808 14:59:05.994721 12582 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-kms:/tmp/dist-test-tasktuKHj1/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasktuKHj1/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 14:59:05.994791 12582 mini_ranger_kms.cc:240] Using host: 127.12.73.148
I20260808 14:59:06.018308 12582 mini_ranger_kms.cc:276] Ranger KMS PID: 357
I20260808 14:59:06.018455 12582 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.73.148:50291
Aug 08, 2026 2:59:06 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:59:06 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:59:07 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:59:07 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:59:07 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:59:07 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 14:59:08 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786201148, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.73.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 14:59:08 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201148, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.73.148@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:59:08.928341 12582 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.980s user 0.067s sys 0.348s
I20260808 14:59:08.928586 12582 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 14:59:08.928769 12582 mini_ranger_kms.cc:401] 127.12.73.148:50291/kms/v1/keys
Aug 08 14:59:09 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201148, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.73.148@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
Aug 08 14:59:11 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:59:11.644915 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34271
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:34271
--ranger_config_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.73.148:50291/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:11.994984 444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:11.995270 444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:11.995442 444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:12.002772 444 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:59:12.002871 444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:12.003000 444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:12.003113 444 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:59:12.003237 444 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:59:12.013350 444 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.73.148:50291/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:34271
--ranger_config_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:12.014639 444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:12.015971 444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:12.028760 456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:12.028868 455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:12.028739 460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:12.029346 444 server_base.cc:1034] running on GCE node
I20260808 14:59:12.030210 444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:12.031535 444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:12.032773 444 hybrid_clock.cc:648] HybridClock initialized: now 1786201152032731 us; error 57 us; skew 500 ppm
I20260808 14:59:12.033110 444 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:12 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201152, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:12.040117 444 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:59:12.041790 444 webserver.cc:460] Webserver started at http://127.12.73.190:42661/ using document root <none> and password file <none>
I20260808 14:59:12.042446 444 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:12.042591 444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:12.042932 444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:59:12 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201152, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:59:12.116680 444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952"
format_stamp: "Formatted at 2026-08-08 14:59:12 on dist-test-slave-z8x9"
server_key: "924e66cc9f504df88de5f379a0153d19"
server_key_iv: "5f1e3cfefbbc2e4e312e6cceb366e8e5"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:12.117993 444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952"
format_stamp: "Formatted at 2026-08-08 14:59:12 on dist-test-slave-z8x9"
server_key: "924e66cc9f504df88de5f379a0153d19"
server_key_iv: "5f1e3cfefbbc2e4e312e6cceb366e8e5"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:12.126514 444 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260808 14:59:12.148442 472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:12.150154 444 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 14:59:12.150359 444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952"
format_stamp: "Formatted at 2026-08-08 14:59:12 on dist-test-slave-z8x9"
server_key: "924e66cc9f504df88de5f379a0153d19"
server_key_iv: "5f1e3cfefbbc2e4e312e6cceb366e8e5"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:12.150614 444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:12.173148 444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:12.177361 444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:12.177630 444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:12.196442 444 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:34271
I20260808 14:59:12.196466 547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:34271 every 8 connection(s)
I20260808 14:59:12.197852 444 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:59:12.201470 548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:12.205984 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 444
I20260808 14:59:12.206192 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:59:12.207067 12582 external_mini_cluster.cc:1428] Setting key b8644ce6b57a67d2a7cfd9538a3f1733
I20260808 14:59:12.212980 548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952: Bootstrap starting.
I20260808 14:59:12.216609 548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:12.217830 548 log.cc:824] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:12.221282 548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952: No bootstrap required, opened a new log
Aug 08 14:59:12 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:12.229427 548 raft_consensus.cc:348] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34271 } }
I20260808 14:59:12.229841 548 raft_consensus.cc:374] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:12.229966 548 raft_consensus.cc:729] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 823dd3c5a34a4c0ba8a0ca36c5a4f952, State: Initialized, Role: FOLLOWER
I20260808 14:59:12.230580 554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:12.209098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52590 (local address 127.12.73.190:34271)
0808 14:59:12.209966 (+ 868us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:12.209989 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:12.210031 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:59:12.211773 (+ 1742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:12.211794 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:12.212143 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:12.212447 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:12.214141 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:12.215453 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:12.217424 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:12.218153 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:12.218407 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:12.223157 (+ 4750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:12.223165 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:12.223181 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:12.223227 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:12.226394 (+ 3167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:12.227089 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:12.227095 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:12.227102 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:12.227268 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:12.227664 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:12.227667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:12.227670 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:12.228215 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:12.228560 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:12.228986 (+ 426us) server_negotiation.cc:299] Negotiation successful
0808 14:59:12.229405 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":413,"threads_started":1}
I20260808 14:59:12.230511 548 consensus_queue.cc:260] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34271 } }
I20260808 14:59:12.230785 548 raft_consensus.cc:388] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:59:12.230959 548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:59:12.231172 548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:12.233675 548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34271 } }
I20260808 14:59:12.234156 548 leader_election.cc:302] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 823dd3c5a34a4c0ba8a0ca36c5a4f952; no voters:
I20260808 14:59:12.234709 548 leader_election.cc:288] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:59:12.234856 556 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:59:12.235494 556 raft_consensus.cc:686] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 1 LEADER]: Becoming Leader. State: Replica: 823dd3c5a34a4c0ba8a0ca36c5a4f952, State: Running, Role: LEADER
I20260808 14:59:12.236024 556 consensus_queue.cc:237] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34271 } }
I20260808 14:59:12.237721 548 sys_catalog.cc:564] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:59:12.238539 560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 823dd3c5a34a4c0ba8a0ca36c5a4f952. Latest consensus state: current_term: 1 leader_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34271 } } }
I20260808 14:59:12.239636 560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:12.239228 561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34271 } } }
I20260808 14:59:12.240245 561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:12.241529 567 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:59:12.246635 567 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:59:12.250233 548 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:59:12.264794 567 catalog_manager.cc:1347] Generated new cluster ID: f36933590b11418f86e6ff2d12397cb0
I20260808 14:59:12.265004 567 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:59:12.277016 567 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:59:12.279045 567 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:59:12.291180 567 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952: Generated new TSK 0
I20260808 14:59:12.292289 567 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:59:13.077455 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.73.148:50291/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34271
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:59:13 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786201153, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 14:59:13.522882 619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:13.523290 619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:13.523514 619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:13.532130 619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:13.532245 619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:13.532447 619 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:59:13.542917 619 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.73.148:50291/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34271
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:13.544324 619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:13.545711 619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:13.569895 642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:13.571826 641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:13.578925 644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:13.579741 619 server_base.cc:1034] running on GCE node
I20260808 14:59:13.580745 619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:13.581972 619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:13.583249 619 hybrid_clock.cc:648] HybridClock initialized: now 1786201153583185 us; error 60 us; skew 500 ppm
I20260808 14:59:13.583591 619 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:13 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201153, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:13.586993 619 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:59:13.589591 619 webserver.cc:460] Webserver started at http://127.12.73.129:36689/ using document root <none> and password file <none>
I20260808 14:59:13.590355 619 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:13.590520 619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:13.590844 619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:59:13 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201153, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:59:13.610401 619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "4842b66ea24c4dcea394d1fc3511049c"
format_stamp: "Formatted at 2026-08-08 14:59:13 on dist-test-slave-z8x9"
server_key: "fbbfa248e7a3e6662d0f7b94617aecf3"
server_key_iv: "c31d73df9b7dc80e4cd0fa1099758773"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:13.612587 619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "4842b66ea24c4dcea394d1fc3511049c"
format_stamp: "Formatted at 2026-08-08 14:59:13 on dist-test-slave-z8x9"
server_key: "fbbfa248e7a3e6662d0f7b94617aecf3"
server_key_iv: "c31d73df9b7dc80e4cd0fa1099758773"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:13.634035 619 fs_manager.cc:691] Time spent creating directory manager: real 0.021s user 0.008s sys 0.012s
I20260808 14:59:13.669924 655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:13.671962 619 fs_manager.cc:725] Time spent opening block manager: real 0.018s user 0.001s sys 0.012s
I20260808 14:59:13.672228 619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "4842b66ea24c4dcea394d1fc3511049c"
format_stamp: "Formatted at 2026-08-08 14:59:13 on dist-test-slave-z8x9"
server_key: "fbbfa248e7a3e6662d0f7b94617aecf3"
server_key_iv: "c31d73df9b7dc80e4cd0fa1099758773"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:13.672582 619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:13.723194 619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:13.728487 619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:13.728909 619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:13.750263 619 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
Aug 08 14:59:13 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201153, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:59:13.764693 619 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:13.764835 619 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:13.764978 619 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:13.765065 619 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:13.865473 619 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:41779
I20260808 14:59:13.865527 831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:41779 every 8 connection(s)
I20260808 14:59:13.867152 619 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:59:13.872798 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 619
I20260808 14:59:13.873049 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:59:13.874215 12582 external_mini_cluster.cc:1428] Setting key d1958862cd89cc4c072551be4b50c6d9
Aug 08 14:59:13 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201153, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:13.913229 835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:13.870961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34271 (local address 127.12.73.129:37997)
0808 14:59:13.890598 (+ 19637us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:13.890646 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:13.892915 (+ 2269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:13.894175 (+ 1260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:13.894188 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:13.894894 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:13.895793 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:13.895821 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:13.897523 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:13.897528 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:13.899364 (+ 1836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:13.899379 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:13.900581 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:13.900589 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:13.900872 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:13.901749 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:13.901777 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:13.904530 (+ 2753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:13.908645 (+ 4115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:13.908653 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:13.908670 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:13.909255 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:13.909732 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:13.909737 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:13.909740 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:13.909967 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:13.910670 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:13.910678 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:13.911093 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 14:59:13.911412 (+ 319us) client_negotiation.cc:240] Negotiation successful
0808 14:59:13.911908 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19284,"thread_start_us":30076,"threads_started":1}
I20260808 14:59:13.914433 834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:13.870248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:37997 (local address 127.12.73.190:34271)
0808 14:59:13.888769 (+ 18521us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:13.888776 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:13.890759 (+ 1983us) server_negotiation.cc:407] Connection header received
0808 14:59:13.893331 (+ 2572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:13.893337 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:13.893418 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:13.893492 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:13.896029 (+ 2537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:13.897299 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:13.899538 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:13.900138 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:13.900237 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:13.904789 (+ 4552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:13.904796 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:13.904801 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:13.904841 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:13.908476 (+ 3635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:13.909416 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:13.909422 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:13.909426 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:13.909593 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:13.910096 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:13.910101 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:13.910104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:13.910451 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:13.910598 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:13.913818 (+ 3220us) server_negotiation.cc:299] Negotiation successful
0808 14:59:13.914064 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18354,"thread_start_us":18514,"threads_started":1}
I20260808 14:59:13.916584 832 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34271
I20260808 14:59:13.916894 832 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:13.917773 832 heartbeater.cc:511] Master 127.12.73.190:34271 requested a full tablet report, sending...
I20260808 14:59:13.920207 493 ts_manager.cc:194] Registered new tserver with Master: 4842b66ea24c4dcea394d1fc3511049c (127.12.73.129:41779)
I20260808 14:59:13.922236 493 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:37997
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:59:13.968858 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.73.148:50291/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34271
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:59:14 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201153, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
W20260808 14:59:14.472220 839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:14.472740 839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:14.472923 839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:14.483110 839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:14.483304 839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:14.483476 839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:59:14.498164 839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.73.148:50291/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34271
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:14.499778 839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:14.501441 839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:14.517907 859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:14.521252 858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:14.524910 862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:14.525702 839 server_base.cc:1034] running on GCE node
I20260808 14:59:14.526480 839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:14.527704 839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:14.529012 839 hybrid_clock.cc:648] HybridClock initialized: now 1786201154528952 us; error 42 us; skew 500 ppm
I20260808 14:59:14.529423 839 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:14 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201154, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:14.533756 839 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:59:14.535952 839 webserver.cc:460] Webserver started at http://127.12.73.130:43369/ using document root <none> and password file <none>
I20260808 14:59:14.536880 839 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:14.537020 839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:14.537424 839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:59:14 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201154, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:59:14.557159 839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "975d2477dc1b41daaea5eaa5a9bfa629"
format_stamp: "Formatted at 2026-08-08 14:59:14 on dist-test-slave-z8x9"
server_key: "5c8853ce30481de3041aba0817bca3b2"
server_key_iv: "9489aac0e23e04995951f5b2150cddc9"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:14.558387 839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "975d2477dc1b41daaea5eaa5a9bfa629"
format_stamp: "Formatted at 2026-08-08 14:59:14 on dist-test-slave-z8x9"
server_key: "5c8853ce30481de3041aba0817bca3b2"
server_key_iv: "9489aac0e23e04995951f5b2150cddc9"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:14.578600 839 fs_manager.cc:691] Time spent creating directory manager: real 0.020s user 0.016s sys 0.003s
I20260808 14:59:14.617915 870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:14.622566 839 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.009s sys 0.005s
I20260808 14:59:14.622881 839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "975d2477dc1b41daaea5eaa5a9bfa629"
format_stamp: "Formatted at 2026-08-08 14:59:14 on dist-test-slave-z8x9"
server_key: "5c8853ce30481de3041aba0817bca3b2"
server_key_iv: "9489aac0e23e04995951f5b2150cddc9"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:14.623246 839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:14.674418 839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:14.680416 839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:14.680851 839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:14.688494 839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:14.696707 839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:14.696882 839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:14.697052 839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:14.697194 839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:14.925946 832 heartbeater.cc:503] Master 127.12.73.190:34271 was elected leader, sending a full tablet report...
I20260808 14:59:14.961318 839 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:45455
I20260808 14:59:14.961337 1036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:45455 every 8 connection(s)
I20260808 14:59:14.962812 839 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:59:14.972987 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 839
I20260808 14:59:14.973204 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:59:14.973793 12582 external_mini_cluster.cc:1428] Setting key 76a279e41a6237c92e3090223d968998
Aug 08 14:59:14 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201154, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:14.986912 1039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:14.965849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:54231 (local address 127.12.73.190:34271)
0808 14:59:14.966495 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:14.966500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:14.967397 (+ 897us) server_negotiation.cc:407] Connection header received
0808 14:59:14.969359 (+ 1962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:14.969365 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:14.969457 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:14.969584 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:14.971066 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:14.971820 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:14.973566 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:14.974058 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:14.974203 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:14.978636 (+ 4433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:14.978645 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:14.978652 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:14.978698 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:14.982924 (+ 4226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:14.983878 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:14.983887 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:14.983893 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:14.984050 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:14.984595 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:14.984602 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:14.984608 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:14.985035 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:14.985224 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:14.986116 (+ 892us) server_negotiation.cc:299] Negotiation successful
0808 14:59:14.986384 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":371,"threads_started":1}
I20260808 14:59:14.987929 1040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:14.966435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34271 (local address 127.12.73.130:54231)
0808 14:59:14.967205 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:14.967251 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:14.969021 (+ 1770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:14.969847 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:14.969855 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:14.970309 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:14.970888 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:14.970906 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:14.972002 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:14.972006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:14.973412 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:14.973431 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:14.974302 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:14.974310 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:14.974645 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:14.975453 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:14.975476 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:14.978371 (+ 2895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:14.983091 (+ 4720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:14.983101 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:14.983121 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:14.983711 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:14.984174 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:14.984179 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:14.984182 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:14.984431 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:14.985219 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:14.985228 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:14.985668 (+ 440us) client_negotiation.cc:769] Sending connection context
0808 14:59:14.985969 (+ 301us) client_negotiation.cc:240] Negotiation successful
0808 14:59:14.986526 (+ 557us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":334,"threads_started":1}
I20260808 14:59:14.989652 1037 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34271
I20260808 14:59:14.989985 1037 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:14.990643 1037 heartbeater.cc:511] Master 127.12.73.190:34271 requested a full tablet report, sending...
I20260808 14:59:14.992179 493 ts_manager.cc:194] Registered new tserver with Master: 975d2477dc1b41daaea5eaa5a9bfa629 (127.12.73.130:45455)
I20260808 14:59:14.993295 493 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:54231
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:59:15.044822 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.73.148:50291/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34271
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:15.384531 1045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:15.384804 1045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:15.384965 1045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:15.392103 1045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:15.392231 1045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:15.392421 1045 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:59:15.402033 1045 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.73.148:50291/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:34271
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:15.403260 1045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:15.404556 1045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:15.417474 1052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:15.417528 1051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:15.417528 1054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:15.418485 1045 server_base.cc:1034] running on GCE node
I20260808 14:59:15.419080 1045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:15.420019 1045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:15.421273 1045 hybrid_clock.cc:648] HybridClock initialized: now 1786201155421219 us; error 58 us; skew 500 ppm
I20260808 14:59:15.421597 1045 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:15 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201155, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:15.424832 1045 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:59:15.426307 1045 webserver.cc:460] Webserver started at http://127.12.73.131:46411/ using document root <none> and password file <none>
I20260808 14:59:15.426982 1045 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:15.427130 1045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:15.427443 1045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:59:15 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201155, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:59:15.445046 1045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "56857166d62445538f41fafaa30caa27"
format_stamp: "Formatted at 2026-08-08 14:59:15 on dist-test-slave-z8x9"
server_key: "28135d5bd5789a440a6c00545b0b545c"
server_key_iv: "9fd9b43a978c78316a65e5273cbdd2c3"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:15.446077 1045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "56857166d62445538f41fafaa30caa27"
format_stamp: "Formatted at 2026-08-08 14:59:15 on dist-test-slave-z8x9"
server_key: "28135d5bd5789a440a6c00545b0b545c"
server_key_iv: "9fd9b43a978c78316a65e5273cbdd2c3"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:15.452600 1045 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 14:59:15.469733 1064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:15.471246 1045 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.007s sys 0.000s
I20260808 14:59:15.471442 1045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "56857166d62445538f41fafaa30caa27"
format_stamp: "Formatted at 2026-08-08 14:59:15 on dist-test-slave-z8x9"
server_key: "28135d5bd5789a440a6c00545b0b545c"
server_key_iv: "9fd9b43a978c78316a65e5273cbdd2c3"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:15.471676 1045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:15.507730 1045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:15.511402 1045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:15.511700 1045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:15.512662 1045 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:15.514508 1045 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:15.514611 1045 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:15.514735 1045 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:15.514818 1045 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:15.549932 1045 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:43579
I20260808 14:59:15.549970 1238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:43579 every 8 connection(s)
I20260808 14:59:15.551245 1045 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:59:15.555824 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 1045
I20260808 14:59:15.556028 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:59:15.556473 12582 external_mini_cluster.cc:1428] Setting key 02397771ff52b06e20462a7e71217e76
Aug 08 14:59:15 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201155, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:15.571455 1243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:15.553819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:52405 (local address 127.12.73.190:34271)
0808 14:59:15.554383 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:15.554387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:15.555346 (+ 959us) server_negotiation.cc:407] Connection header received
0808 14:59:15.557310 (+ 1964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:15.557315 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:15.557409 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:15.557538 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:15.559278 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:15.560216 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:15.561757 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:15.562167 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:15.562258 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:15.565528 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:15.565533 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:15.565536 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:15.565566 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:15.568246 (+ 2680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:15.568968 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:15.568972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:15.568975 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:15.569094 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:15.569551 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:15.569554 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:15.569556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:15.569812 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:15.569996 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:15.570856 (+ 860us) server_negotiation.cc:299] Negotiation successful
0808 14:59:15.571099 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":221,"threads_started":1}
I20260808 14:59:15.572418 1244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:15.554424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34271 (local address 127.12.73.131:52405)
0808 14:59:15.555175 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:15.555215 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:15.556920 (+ 1705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:15.557828 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:15.557840 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:15.558328 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:15.559117 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:15.559143 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:15.560356 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:15.560360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:15.561631 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:15.561643 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:15.562353 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:15.562358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:15.562544 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:15.563228 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:15.563254 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:15.565346 (+ 2092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:15.568387 (+ 3041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:15.568394 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:15.568405 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:15.568857 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:15.569245 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:15.569248 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:15.569251 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:15.569444 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:15.569997 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:15.570003 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:15.570412 (+ 409us) client_negotiation.cc:769] Sending connection context
0808 14:59:15.570722 (+ 310us) client_negotiation.cc:240] Negotiation successful
0808 14:59:15.571191 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":306,"threads_started":1}
I20260808 14:59:15.573719 1239 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34271
I20260808 14:59:15.574011 1239 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:15.574719 1239 heartbeater.cc:511] Master 127.12.73.190:34271 requested a full tablet report, sending...
I20260808 14:59:15.576133 493 ts_manager.cc:194] Registered new tserver with Master: 56857166d62445538f41fafaa30caa27 (127.12.73.131:43579)
I20260808 14:59:15.577050 493 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:52405
I20260808 14:59:15.584414 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:59:15.586169 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 619
Aug 08 14:59:15 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:59:15.601953 1248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:15.587047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52422 (local address 127.12.73.129:41779)
0808 14:59:15.587641 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:15.587647 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:15.587670 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:59:15.587724 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:15.587730 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:15.587907 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:15.588029 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:15.589438 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:15.590425 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:15.591827 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:15.592360 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:15.592453 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:15.596693 (+ 4240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:15.596704 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:15.596716 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:15.596750 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:15.599472 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:15.600106 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:15.600113 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:15.600115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:15.600250 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:15.600583 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:15.600586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:15.600588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:15.600901 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:15.601126 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:15.601492 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 14:59:15.601686 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":307,"threads_started":1}
I20260808 14:59:15.603206 821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:15.686758 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 619
I20260808 14:59:15.712061 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 839
Aug 08 14:59:15 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:59:15.729071 1251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:15.713086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33388 (local address 127.12.73.130:45455)
0808 14:59:15.713714 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:15.713720 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:15.713745 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:59:15.713806 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:15.713812 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:15.714041 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:15.714186 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:15.715478 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:15.716463 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:15.718022 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:15.718564 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:15.718659 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:15.723126 (+ 4467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:15.723137 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:15.723149 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:15.723179 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:15.726104 (+ 2925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:15.726809 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:15.726816 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:15.726818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:15.726958 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:15.727354 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:15.727366 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:15.727368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:15.727697 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:15.728010 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:15.728348 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 14:59:15.728652 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":357,"threads_started":1}
I20260808 14:59:15.730535 1030 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:15.812556 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 839
I20260808 14:59:15.840462 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 1045
Aug 08 14:59:15 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:59:15.857247 1254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:15.841561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40576 (local address 127.12.73.131:43579)
0808 14:59:15.842387 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:15.842394 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:15.842424 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:59:15.842505 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:15.842518 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:15.842756 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:15.842964 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:15.844257 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:15.845344 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:15.846725 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:15.847294 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:15.847400 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:15.851776 (+ 4376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:15.851788 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:15.851803 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:15.851840 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:15.854580 (+ 2740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:15.855276 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:15.855283 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:15.855285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:15.855416 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:15.855866 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:15.855870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:15.855872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:15.856200 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:15.856449 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:15.856702 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 14:59:15.856895 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":504,"threads_started":1}
I20260808 14:59:15.858611 1233 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:15.941006 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 1045
I20260808 14:59:15.962004 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 444
I20260808 14:59:15.963295 541 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:16.069836 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 444
I20260808 14:59:16.103603 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34271
--webserver_interface=127.12.73.190
--webserver_port=42661
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:34271
--ranger_config_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.73.148:50291/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.73.148:50291/kms with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:16.433588 1262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:16.433938 1262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:16.434108 1262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:16.441226 1262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:59:16.441380 1262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:16.441484 1262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:16.441582 1262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:59:16.441671 1262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:59:16.451465 1262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.73.148:50291/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:34271
--ranger_config_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=42661
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:16.452710 1262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:16.454072 1262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:16.465565 1271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:16.465512 1273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:16.466004 1270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:16.466415 1262 server_base.cc:1034] running on GCE node
I20260808 14:59:16.467133 1262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:16.468427 1262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:16.469653 1262 hybrid_clock.cc:648] HybridClock initialized: now 1786201156469607 us; error 55 us; skew 500 ppm
I20260808 14:59:16.469995 1262 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:16 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201156, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:16.473238 1262 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:59:16.474627 1262 webserver.cc:460] Webserver started at http://127.12.73.190:42661/ using document root <none> and password file <none>
I20260808 14:59:16.475252 1262 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:16.475409 1262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:59:16 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201156, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:59:16.554760 1262 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 14:59:16.558326 1289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:16.559906 1262 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 14:59:16.560084 1262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952"
format_stamp: "Formatted at 2026-08-08 14:59:12 on dist-test-slave-z8x9"
server_key: "924e66cc9f504df88de5f379a0153d19"
server_key_iv: "5f1e3cfefbbc2e4e312e6cceb366e8e5"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:16.561429 1262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:16.590808 1262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:16.594825 1262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:16.595058 1262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:16.612999 1262 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:34271
I20260808 14:59:16.613019 1371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:34271 every 8 connection(s)
I20260808 14:59:16.614459 1262 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:59:16.620882 1373 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:59:16.621516 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 1262
I20260808 14:59:16.622412 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.73.148:50291/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:41779
--local_ip_for_outbound_sockets=127.12.73.129
--tserver_master_addrs=127.12.73.190:34271
--webserver_port=36689
--webserver_interface=127.12.73.129
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.73.148:50291/kms with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:59:16.624210 1373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952: Bootstrap starting.
I20260808 14:59:16.642402 1373 log.cc:824] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:16.651336 1373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:59:16.651885 1373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952: Bootstrap complete.
I20260808 14:59:16.662299 1373 raft_consensus.cc:348] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34271 } }
I20260808 14:59:16.663748 1373 raft_consensus.cc:729] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 823dd3c5a34a4c0ba8a0ca36c5a4f952, State: Initialized, Role: FOLLOWER
I20260808 14:59:16.664521 1373 consensus_queue.cc:260] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34271 } }
I20260808 14:59:16.664857 1373 raft_consensus.cc:388] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:59:16.665005 1373 raft_consensus.cc:482] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:59:16.665225 1373 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:59:16.669884 1373 raft_consensus.cc:504] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34271 } }
I20260808 14:59:16.670360 1373 leader_election.cc:302] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 823dd3c5a34a4c0ba8a0ca36c5a4f952; no voters:
I20260808 14:59:16.670980 1373 leader_election.cc:288] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:59:16.671123 1377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:59:16.673410 1373 sys_catalog.cc:564] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:59:16.677850 1377 raft_consensus.cc:686] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [term 2 LEADER]: Becoming Leader. State: Replica: 823dd3c5a34a4c0ba8a0ca36c5a4f952, State: Running, Role: LEADER
I20260808 14:59:16.678422 1377 consensus_queue.cc:237] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34271 } }
I20260808 14:59:16.681216 1378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34271 } } }
I20260808 14:59:16.681241 1379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 823dd3c5a34a4c0ba8a0ca36c5a4f952. Latest consensus state: current_term: 2 leader_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823dd3c5a34a4c0ba8a0ca36c5a4f952" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34271 } } }
I20260808 14:59:16.681725 1379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:16.681721 1378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952 [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:16.689477 1389 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:59:16.694964 1389 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:59:16.695788 1373 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:59:16.696405 1389 catalog_manager.cc:1259] Loaded cluster ID: f36933590b11418f86e6ff2d12397cb0
I20260808 14:59:16.696568 1389 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:59:16.700560 1389 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:59:16.702047 1389 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952: Loaded TSK: 0
I20260808 14:59:16.703644 1389 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:59:17.038334 1375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:17.038851 1375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:17.039090 1375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:17.050796 1375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:17.051025 1375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:17.051290 1375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:59:17.066951 1375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.73.148:50291/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:41779
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=36689
--tserver_master_addrs=127.12.73.190:34271
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:17.068823 1375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:17.070426 1375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:17.108500 1420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:17.110978 1419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:17.112617 1424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:17.113143 1375 server_base.cc:1034] running on GCE node
I20260808 14:59:17.114046 1375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:17.118036 1375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:17.119340 1375 hybrid_clock.cc:648] HybridClock initialized: now 1786201157119279 us; error 53 us; skew 500 ppm
I20260808 14:59:17.119704 1375 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:17 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:17.126397 1375 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:59:17.128588 1375 webserver.cc:460] Webserver started at http://127.12.73.129:36689/ using document root <none> and password file <none>
I20260808 14:59:17.129452 1375 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:17.129686 1375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:59:17 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:59:17.170384 1375 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 14:59:17.177875 1434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:17.180051 1375 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.008s sys 0.000s
I20260808 14:59:17.180262 1375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "4842b66ea24c4dcea394d1fc3511049c"
format_stamp: "Formatted at 2026-08-08 14:59:13 on dist-test-slave-z8x9"
server_key: "fbbfa248e7a3e6662d0f7b94617aecf3"
server_key_iv: "c31d73df9b7dc80e4cd0fa1099758773"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:17.181845 1375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:17.234386 1375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:17.239946 1375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:17.240315 1375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:17.241742 1375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:17.254159 1375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:17.254338 1375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 14:59:17.254488 1375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:17.254590 1375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:17.364528 1375 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:41779
I20260808 14:59:17.364620 1617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:41779 every 8 connection(s)
I20260808 14:59:17.366040 1375 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:59:17.371167 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 1375
I20260808 14:59:17.372255 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.73.148:50291/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:45455
--local_ip_for_outbound_sockets=127.12.73.130
--tserver_master_addrs=127.12.73.190:34271
--webserver_port=43369
--webserver_interface=127.12.73.130
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.73.148:50291/kms with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:59:17 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:17.405058 1620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:17.369602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34271 (local address 127.12.73.129:34951)
0808 14:59:17.378345 (+ 8743us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:17.378392 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:17.380279 (+ 1887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:17.381992 (+ 1713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:17.382005 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:17.382702 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:17.383528 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:17.383557 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:17.386064 (+ 2507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:17.386070 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:17.388239 (+ 2169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:17.388273 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:17.389898 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:17.389907 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:17.390224 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:17.391074 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:17.391110 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:17.394259 (+ 3149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:17.399409 (+ 5150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:17.399421 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:17.399441 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:17.400155 (+ 714us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:17.400756 (+ 601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:17.400761 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:17.400765 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:17.401047 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:17.402218 (+ 1171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:17.402226 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:17.402660 (+ 434us) client_negotiation.cc:769] Sending connection context
0808 14:59:17.403001 (+ 341us) client_negotiation.cc:240] Negotiation successful
0808 14:59:17.403603 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8491,"thread_start_us":8303,"threads_started":1}
I20260808 14:59:17.405153 1621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:17.369680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:34951 (local address 127.12.73.190:34271)
0808 14:59:17.377767 (+ 8087us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:17.377783 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:17.378551 (+ 768us) server_negotiation.cc:407] Connection header received
0808 14:59:17.380880 (+ 2329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:17.380893 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:17.381366 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:17.381772 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:17.383790 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:17.385875 (+ 2085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:17.388456 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:17.389615 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:17.389819 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:17.394599 (+ 4780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:17.394612 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:17.394634 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:17.394707 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:17.399233 (+ 4526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:17.400354 (+ 1121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:17.400366 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:17.400376 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:17.400592 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:17.401221 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:17.401229 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:17.401235 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:17.401977 (+ 742us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:17.402206 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:17.403253 (+ 1047us) server_negotiation.cc:299] Negotiation successful
0808 14:59:17.403723 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7803,"thread_start_us":7570,"threads_started":1}
I20260808 14:59:17.410425 1618 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34271
I20260808 14:59:17.410844 1618 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:17.411844 1618 heartbeater.cc:511] Master 127.12.73.190:34271 requested a full tablet report, sending...
W20260808 14:59:17.415408 1618 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:34271 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:59:17.415726 1618 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:17.416079 1618 heartbeater.cc:511] Master 127.12.73.190:34271 requested a full tablet report, sending...
I20260808 14:59:17.420436 1618 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:17.420740 1618 heartbeater.cc:511] Master 127.12.73.190:34271 requested a full tablet report, sending...
W20260808 14:59:17.421937 1618 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:59:17.798532 1625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:17.798874 1625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:17.799034 1625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:17.810248 1625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:17.810402 1625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:17.810647 1625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:59:17.826560 1625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.73.148:50291/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:45455
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=43369
--tserver_master_addrs=127.12.73.190:34271
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:17.828004 1625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:17.829432 1625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:17.847314 1646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:17.847313 1644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:17.854286 1625 server_base.cc:1034] running on GCE node
W20260808 14:59:17.855360 1651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:17.856293 1625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:17.864064 1625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:17.866178 1625 hybrid_clock.cc:648] HybridClock initialized: now 1786201157866114 us; error 93 us; skew 500 ppm
I20260808 14:59:17.866657 1625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:17 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:17.871196 1625 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:59:17.880838 1625 webserver.cc:460] Webserver started at http://127.12.73.130:43369/ using document root <none> and password file <none>
I20260808 14:59:17.882028 1625 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:17.882263 1625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:59:17 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:59:17.912266 1625 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:59:17.916003 1669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:17.917969 1625 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 14:59:17.918150 1625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "975d2477dc1b41daaea5eaa5a9bfa629"
format_stamp: "Formatted at 2026-08-08 14:59:14 on dist-test-slave-z8x9"
server_key: "5c8853ce30481de3041aba0817bca3b2"
server_key_iv: "9489aac0e23e04995951f5b2150cddc9"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:17.919555 1625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:17.958542 1625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:17.963981 1625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:17.964339 1625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:17.965709 1625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
Aug 08 14:59:17 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786201157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:17.967808 1625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:17.967932 1625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:17.968043 1625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:17.968127 1625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:18.032606 1625 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:45455
I20260808 14:59:18.032753 1872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:45455 every 8 connection(s)
I20260808 14:59:18.034375 1625 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:59:18.044708 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 1625
I20260808 14:59:18.045554 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.73.148:50291/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:43579
--local_ip_for_outbound_sockets=127.12.73.131
--tserver_master_addrs=127.12.73.190:34271
--webserver_port=46411
--webserver_interface=127.12.73.131
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.73.148:50291/kms with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:59:18 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:18.073489 1876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:18.037658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:32933 (local address 127.12.73.190:34271)
0808 14:59:18.038233 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:18.038239 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:18.040284 (+ 2045us) server_negotiation.cc:407] Connection header received
0808 14:59:18.043144 (+ 2860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:18.043150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:18.043247 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:18.043330 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:18.053758 (+ 10428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:18.054962 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:18.057647 (+ 2685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:18.058358 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:18.058438 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:18.064061 (+ 5623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:18.064070 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:18.064079 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:18.064125 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:18.069186 (+ 5061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:18.070241 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:18.070249 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:18.070255 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:18.070439 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:18.071036 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:18.071043 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:18.071049 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:18.071464 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:18.071615 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:18.072723 (+ 1108us) server_negotiation.cc:299] Negotiation successful
0808 14:59:18.072987 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":1825,"threads_started":1}
I20260808 14:59:18.076498 1877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:18.039113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34271 (local address 127.12.73.130:32933)
0808 14:59:18.040101 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:18.040158 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:18.042797 (+ 2639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:18.043903 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:18.043915 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:18.052607 (+ 8692us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:18.053522 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:18.053553 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:18.055176 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:18.055184 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:18.057455 (+ 2271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:18.057475 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:18.058747 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:18.058751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:18.058939 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:18.060696 (+ 1757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:18.060738 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:18.063805 (+ 3067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:18.069390 (+ 5585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:18.069402 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:18.069422 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:18.070067 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:18.070602 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:18.070609 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:18.070615 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:18.070891 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:18.071730 (+ 839us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:18.071741 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:18.072226 (+ 485us) client_negotiation.cc:769] Sending connection context
0808 14:59:18.074155 (+ 1929us) client_negotiation.cc:240] Negotiation successful
0808 14:59:18.074823 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":401,"threads_started":1}
I20260808 14:59:18.080598 1873 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34271
I20260808 14:59:18.080956 1873 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:18.081940 1873 heartbeater.cc:511] Master 127.12.73.190:34271 requested a full tablet report, sending...
I20260808 14:59:18.084101 1311 ts_manager.cc:194] Registered new tserver with Master: 975d2477dc1b41daaea5eaa5a9bfa629 (127.12.73.130:45455)
I20260808 14:59:18.086347 1311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:32933
I20260808 14:59:18.422103 1618 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:18.422597 1618 heartbeater.cc:511] Master 127.12.73.190:34271 requested a full tablet report, sending...
I20260808 14:59:18.423877 1311 ts_manager.cc:194] Registered new tserver with Master: 4842b66ea24c4dcea394d1fc3511049c (127.12.73.129:41779)
I20260808 14:59:18.424997 1311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:34951
Aug 08 14:59:18 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
W20260808 14:59:18.468511 1880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:18.468879 1880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:18.469038 1880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:18.480384 1880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:18.480532 1880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:18.480743 1880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:59:18.496662 1880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.73.148:50291/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:43579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=46411
--tserver_master_addrs=127.12.73.190:34271
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:18.498374 1880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:18.500022 1880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:18.557621 1893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:18.557804 1886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:18.558132 1888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:18.558307 1880 server_base.cc:1034] running on GCE node
I20260808 14:59:18.559305 1880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:18.565428 1880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:18.567378 1880 hybrid_clock.cc:648] HybridClock initialized: now 1786201158567297 us; error 79 us; skew 500 ppm
I20260808 14:59:18.567842 1880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:18 dist-test-slave-z8x9 krb5kdc[32214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201158, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:18.572598 1880 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:59:18.617141 1880 webserver.cc:460] Webserver started at http://127.12.73.131:46411/ using document root <none> and password file <none>
I20260808 14:59:18.618233 1880 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:18.618472 1880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:59:18 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201158, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:59:18.672310 1880 fs_manager.cc:709] Time spent opening directory manager: real 0.019s user 0.008s sys 0.004s
I20260808 14:59:18.692345 1907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:18.694612 1880 fs_manager.cc:725] Time spent opening block manager: real 0.020s user 0.013s sys 0.004s
I20260808 14:59:18.694824 1880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "56857166d62445538f41fafaa30caa27"
format_stamp: "Formatted at 2026-08-08 14:59:15 on dist-test-slave-z8x9"
server_key: "28135d5bd5789a440a6c00545b0b545c"
server_key_iv: "9fd9b43a978c78316a65e5273cbdd2c3"
server_key_version: "kuduclusterkey@0"
I20260808 14:59:18.696368 1880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:18.751729 1880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:18.761656 1880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:18.761955 1880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:18.769393 1880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:18.777493 1880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:18.777618 1880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:18.777794 1880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:18.777882 1880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 08 14:59:18 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for HTTP/127.12.73.148@KRBTEST.COM
I20260808 14:59:18.903774 1880 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:43579
I20260808 14:59:18.903864 2097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:43579 every 8 connection(s)
I20260808 14:59:18.905819 1880 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:59:18.915773 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 1880
Aug 08 14:59:18 dist-test-slave-z8x9 krb5kdc[32214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201158, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:18.963719 2104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:18.916797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44610 (local address 127.12.73.190:34271)
0808 14:59:18.943845 (+ 27048us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:18.943851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:18.943868 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:59:18.943912 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:18.943916 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:18.943991 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:18.944085 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:18.946530 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:18.947675 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:18.949712 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:18.950359 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:18.950504 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:18.954544 (+ 4040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:18.954550 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:18.954555 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:18.954595 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:18.958596 (+ 4001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:18.959526 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:18.959532 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:18.959536 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:18.959709 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:18.960220 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:18.960225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:18.960229 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:18.960600 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:18.960886 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:18.963084 (+ 2198us) server_negotiation.cc:299] Negotiation successful
0808 14:59:18.963316 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26940,"thread_start_us":26805,"threads_started":1}
I20260808 14:59:18.980432 2103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:18.915659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34271 (local address 127.12.73.131:57523)
0808 14:59:18.927016 (+ 11357us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:18.927083 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:18.929621 (+ 2538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:18.948473 (+ 18852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:18.948488 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:18.949161 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:18.950067 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:18.950093 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:18.951846 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:18.951851 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:18.953925 (+ 2074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:18.953943 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:18.955350 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:18.955358 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:18.955646 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:18.960165 (+ 4519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:18.960198 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:18.965432 (+ 5234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:18.972352 (+ 6920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:18.972362 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:18.972380 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:18.973054 (+ 674us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:18.973624 (+ 570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:18.973629 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:18.973633 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:18.973934 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:18.974749 (+ 815us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:18.974757 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:18.975229 (+ 472us) client_negotiation.cc:769] Sending connection context
0808 14:59:18.975540 (+ 311us) client_negotiation.cc:240] Negotiation successful
0808 14:59:18.976144 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10976,"thread_start_us":14259,"threads_started":1}
I20260808 14:59:18.981011 2101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:18.915055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:57523 (local address 127.12.73.190:34271)
0808 14:59:18.942818 (+ 27763us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:18.942828 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:18.942858 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:59:18.942946 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:18.942953 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:18.943089 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:18.943244 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:18.950354 (+ 7110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:18.951646 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:18.954121 (+ 2475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:18.954877 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:18.955009 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:18.965752 (+ 10743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:18.965759 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:18.965764 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:18.965808 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:18.972167 (+ 6359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:18.973260 (+ 1093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:18.973265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:18.973268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:18.973476 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:18.974084 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:18.974089 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:18.974093 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:18.974452 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:18.974631 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:18.977361 (+ 2730us) server_negotiation.cc:299] Negotiation successful
0808 14:59:18.977616 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27585,"thread_start_us":27451,"threads_started":1}
I20260808 14:59:18.982808 2098 heartbeater.cc:347] Connected to a master server at 127.12.73.190:34271
I20260808 14:59:18.983165 2098 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:18.983903 2098 heartbeater.cc:511] Master 127.12.73.190:34271 requested a full tablet report, sending...
I20260808 14:59:18.985489 1311 ts_manager.cc:194] Registered new tserver with Master: 56857166d62445538f41fafaa30caa27 (127.12.73.131:43579)
I20260808 14:59:18.986654 1311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:57523
I20260808 14:59:18.992269 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:59:19.044071 2101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.018692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44626 (local address 127.12.73.190:34271)
0808 14:59:19.018887 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:19.018894 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:19.019396 (+ 502us) server_negotiation.cc:407] Connection header received
0808 14:59:19.019592 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:19.019598 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:19.019680 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:19.019797 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:19.021955 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.023115 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.025195 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.025755 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.025849 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.029634 (+ 3785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:19.029641 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:19.029646 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:19.029691 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:19.039247 (+ 9556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:19.041546 (+ 2299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:19.041553 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:19.041556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:19.041721 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:19.042239 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:19.042245 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:19.042248 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:19.042627 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:19.042858 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:19.043473 (+ 615us) server_negotiation.cc:299] Negotiation successful
0808 14:59:19.043718 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:59:19.051527 1311 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44626:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:59:19.062033 1311 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:59:19.091722 1873 heartbeater.cc:503] Master 127.12.73.190:34271 was elected leader, sending a full tablet report...
I20260808 14:59:19.138972 2131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.126011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:45455 (local address 127.0.0.1:33402)
0808 14:59:19.128163 (+ 2152us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.128182 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:19.128303 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:19.129235 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:19.129241 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:19.129267 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:19.129614 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:19.129625 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.132634 (+ 3009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.132639 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:19.136033 (+ 3394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:19.136047 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.138195 (+ 2148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.138201 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:19.138363 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.138392 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 14:59:19.138458 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:59:19.138555 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2041,"mutex_wait_us":23,"thread_start_us":1922,"threads_started":1}
I20260808 14:59:19.140884 2130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.123014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33402 (local address 127.12.73.130:45455)
0808 14:59:19.125851 (+ 2837us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:19.125859 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:19.128420 (+ 2561us) server_negotiation.cc:407] Connection header received
0808 14:59:19.128521 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:19.128528 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:19.128779 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:19.128958 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:19.129814 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.132478 (+ 2664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.136217 (+ 3739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.137665 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.137823 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.138041 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:19.139248 (+ 1207us) server_negotiation.cc:299] Negotiation successful
0808 14:59:19.140519 (+ 1271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2660,"thread_start_us":2712,"threads_started":1}
I20260808 14:59:19.142421 2129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.092095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52432 (local address 127.12.73.129:41779)
0808 14:59:19.119003 (+ 26908us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:19.119013 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:19.122335 (+ 3322us) server_negotiation.cc:407] Connection header received
0808 14:59:19.122455 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:19.122463 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:19.122749 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:19.122964 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:19.128961 (+ 5997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.130630 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.135474 (+ 4844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.136993 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.137150 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.137428 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:19.138721 (+ 1293us) server_negotiation.cc:299] Negotiation successful
0808 14:59:19.138896 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26684,"thread_start_us":26930,"threads_started":1}
I20260808 14:59:19.143194 2128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.091656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40592 (local address 127.12.73.131:43579)
0808 14:59:19.119696 (+ 28040us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:19.119815 (+ 119us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:19.123909 (+ 4094us) server_negotiation.cc:407] Connection header received
0808 14:59:19.124018 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:19.124025 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:19.124283 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:19.124464 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:19.125536 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.127214 (+ 1678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.139684 (+ 12470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.141271 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.141386 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.141584 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:19.142726 (+ 1142us) server_negotiation.cc:299] Negotiation successful
0808 14:59:19.142907 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27867,"thread_start_us":36426,"threads_started":1}
I20260808 14:59:19.144091 2127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.091258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:43579 (local address 127.0.0.1:40592)
0808 14:59:19.123620 (+ 32362us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.123640 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:19.123779 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:19.124798 (+ 1019us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:19.124806 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:19.124840 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:19.125327 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:19.125342 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.130870 (+ 5528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.130876 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:19.137646 (+ 6770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:19.137661 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.141906 (+ 4245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.141912 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:19.142083 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.142119 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 14:59:19.143557 (+ 1438us) client_negotiation.cc:240] Negotiation successful
0808 14:59:19.143713 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32231,"mutex_wait_us":4276,"thread_start_us":32101,"threads_started":1}
I20260808 14:59:19.144598 2126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.091077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:41779 (local address 127.0.0.1:52432)
0808 14:59:19.121794 (+ 30717us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.121854 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:19.122088 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:19.128326 (+ 6238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:19.128333 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:19.128361 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:19.128713 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:19.128727 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.133260 (+ 4533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.133265 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:19.135271 (+ 2006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:19.135291 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.137897 (+ 2606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.137904 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:19.138106 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.138180 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 14:59:19.138320 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 14:59:19.138515 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30406,"thread_start_us":30246,"threads_started":1}
I20260808 14:59:19.145435 1746 tablet_service.cc:1467] Processing CreateTablet for tablet e1f7c8d22c5448b19b4a8be39a5878ec (DEFAULT_TABLE table=test-table [id=285ec8d31732447c95db1e32adfd0821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:59:19.148283 1995 tablet_service.cc:1467] Processing CreateTablet for tablet e1f7c8d22c5448b19b4a8be39a5878ec (DEFAULT_TABLE table=test-table [id=285ec8d31732447c95db1e32adfd0821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:59:19.149578 1746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1f7c8d22c5448b19b4a8be39a5878ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:19.149111 1509 tablet_service.cc:1467] Processing CreateTablet for tablet e1f7c8d22c5448b19b4a8be39a5878ec (DEFAULT_TABLE table=test-table [id=285ec8d31732447c95db1e32adfd0821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:59:19.149878 1995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1f7c8d22c5448b19b4a8be39a5878ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:19.150436 1509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1f7c8d22c5448b19b4a8be39a5878ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:19.173221 2132 tablet_bootstrap.cc:492] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27: Bootstrap starting.
I20260808 14:59:19.175374 2133 tablet_bootstrap.cc:492] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629: Bootstrap starting.
I20260808 14:59:19.179333 2133 tablet_bootstrap.cc:654] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:19.182828 2132 tablet_bootstrap.cc:654] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:19.184072 2132 log.cc:824] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:19.185703 2133 log.cc:824] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:19.188081 2132 tablet_bootstrap.cc:492] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27: No bootstrap required, opened a new log
I20260808 14:59:19.188402 2132 ts_tablet_manager.cc:1397] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.006s
I20260808 14:59:19.195848 2133 tablet_bootstrap.cc:492] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629: No bootstrap required, opened a new log
I20260808 14:59:19.196218 2133 ts_tablet_manager.cc:1397] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.005s
I20260808 14:59:19.207379 2133 raft_consensus.cc:348] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4842b66ea24c4dcea394d1fc3511049c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 41779 } } peers { permanent_uuid: "56857166d62445538f41fafaa30caa27" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43579 } } peers { permanent_uuid: "975d2477dc1b41daaea5eaa5a9bfa629" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 45455 } }
I20260808 14:59:19.209518 2138 tablet_bootstrap.cc:492] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c: Bootstrap starting.
I20260808 14:59:19.210345 2133 raft_consensus.cc:374] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:19.210498 2133 raft_consensus.cc:729] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975d2477dc1b41daaea5eaa5a9bfa629, State: Initialized, Role: FOLLOWER
I20260808 14:59:19.211176 2133 consensus_queue.cc:260] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4842b66ea24c4dcea394d1fc3511049c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 41779 } } peers { permanent_uuid: "56857166d62445538f41fafaa30caa27" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43579 } } peers { permanent_uuid: "975d2477dc1b41daaea5eaa5a9bfa629" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 45455 } }
I20260808 14:59:19.213080 2133 ts_tablet_manager.cc:1428] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629: Time spent starting tablet: real 0.017s user 0.009s sys 0.004s
I20260808 14:59:19.213824 2138 tablet_bootstrap.cc:654] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:19.215212 2138 log.cc:824] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:19.216952 2132 raft_consensus.cc:348] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4842b66ea24c4dcea394d1fc3511049c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 41779 } } peers { permanent_uuid: "56857166d62445538f41fafaa30caa27" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43579 } } peers { permanent_uuid: "975d2477dc1b41daaea5eaa5a9bfa629" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 45455 } }
I20260808 14:59:19.217516 2132 raft_consensus.cc:374] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:19.217674 2132 raft_consensus.cc:729] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56857166d62445538f41fafaa30caa27, State: Initialized, Role: FOLLOWER
I20260808 14:59:19.218350 2132 consensus_queue.cc:260] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4842b66ea24c4dcea394d1fc3511049c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 41779 } } peers { permanent_uuid: "56857166d62445538f41fafaa30caa27" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43579 } } peers { permanent_uuid: "975d2477dc1b41daaea5eaa5a9bfa629" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 45455 } }
I20260808 14:59:19.220821 2098 heartbeater.cc:503] Master 127.12.73.190:34271 was elected leader, sending a full tablet report...
I20260808 14:59:19.221565 2132 ts_tablet_manager.cc:1428] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27: Time spent starting tablet: real 0.033s user 0.016s sys 0.002s
I20260808 14:59:19.225397 2138 tablet_bootstrap.cc:492] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c: No bootstrap required, opened a new log
I20260808 14:59:19.225744 2138 ts_tablet_manager.cc:1397] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.003s
I20260808 14:59:19.232719 2138 raft_consensus.cc:348] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4842b66ea24c4dcea394d1fc3511049c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 41779 } } peers { permanent_uuid: "56857166d62445538f41fafaa30caa27" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43579 } } peers { permanent_uuid: "975d2477dc1b41daaea5eaa5a9bfa629" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 45455 } }
I20260808 14:59:19.233081 2138 raft_consensus.cc:374] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:19.233227 2138 raft_consensus.cc:729] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4842b66ea24c4dcea394d1fc3511049c, State: Initialized, Role: FOLLOWER
I20260808 14:59:19.233774 2138 consensus_queue.cc:260] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4842b66ea24c4dcea394d1fc3511049c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 41779 } } peers { permanent_uuid: "56857166d62445538f41fafaa30caa27" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43579 } } peers { permanent_uuid: "975d2477dc1b41daaea5eaa5a9bfa629" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 45455 } }
I20260808 14:59:19.234860 1618 heartbeater.cc:503] Master 127.12.73.190:34271 was elected leader, sending a full tablet report...
I20260808 14:59:19.235428 2138 ts_tablet_manager.cc:1428] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c: Time spent starting tablet: real 0.010s user 0.005s sys 0.004s
I20260808 14:59:19.267874 2150 raft_consensus.cc:482] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:59:19.268247 2150 raft_consensus.cc:504] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4842b66ea24c4dcea394d1fc3511049c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 41779 } } peers { permanent_uuid: "56857166d62445538f41fafaa30caa27" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43579 } } peers { permanent_uuid: "975d2477dc1b41daaea5eaa5a9bfa629" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 45455 } }
I20260808 14:59:19.270395 2150 leader_election.cc:288] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56857166d62445538f41fafaa30caa27 (127.12.73.131:43579), 975d2477dc1b41daaea5eaa5a9bfa629 (127.12.73.130:45455)
I20260808 14:59:19.279618 2130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.270936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:51931 (local address 127.12.73.130:45455)
0808 14:59:19.271181 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:19.271188 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:19.271980 (+ 792us) server_negotiation.cc:407] Connection header received
0808 14:59:19.272270 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:19.272276 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:19.272360 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:19.272430 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:19.273332 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.274489 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.276927 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.278195 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.278384 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.278484 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:19.279110 (+ 626us) server_negotiation.cc:299] Negotiation successful
0808 14:59:19.279308 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:59:19.279693 2151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.271072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:45455 (local address 127.12.73.129:51931)
0808 14:59:19.271855 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.271875 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:19.272044 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:19.272625 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:19.272632 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:19.272694 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:19.273154 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:19.273193 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.274620 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.274625 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:19.276761 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:19.276776 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.278647 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.278656 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:19.278869 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.278917 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:59:19.279031 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 14:59:19.279194 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":2,"spinlock_wait_cycles":34432,"thread_start_us":689,"threads_started":1}
I20260808 14:59:19.280617 2128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.271021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:53949 (local address 127.12.73.131:43579)
0808 14:59:19.271279 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:19.271288 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:19.272661 (+ 1373us) server_negotiation.cc:407] Connection header received
0808 14:59:19.272865 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:19.272870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:19.272948 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:19.273053 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:19.273728 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.274812 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.276622 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.277802 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.279658 (+ 1856us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.279746 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:19.280239 (+ 493us) server_negotiation.cc:299] Negotiation successful
0808 14:59:19.280381 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 14:59:19.280718 2152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.271525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:43579 (local address 127.12.73.129:53949)
0808 14:59:19.272471 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.272488 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:19.272712 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:19.273081 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:19.273086 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:19.273114 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:19.273527 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:19.273539 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.274960 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.274968 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:19.276469 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:19.276481 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.279920 (+ 3439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.279928 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:19.280086 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.280108 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:59:19.280211 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 14:59:19.280331 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":827,"mutex_wait_us":47,"spinlock_wait_cycles":896,"thread_start_us":589,"threads_started":1}
I20260808 14:59:19.280697 1784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f7c8d22c5448b19b4a8be39a5878ec" candidate_uuid: "4842b66ea24c4dcea394d1fc3511049c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975d2477dc1b41daaea5eaa5a9bfa629" is_pre_election: true
I20260808 14:59:19.281390 1784 raft_consensus.cc:2454] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4842b66ea24c4dcea394d1fc3511049c in term 0.
I20260808 14:59:19.281719 2020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f7c8d22c5448b19b4a8be39a5878ec" candidate_uuid: "4842b66ea24c4dcea394d1fc3511049c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56857166d62445538f41fafaa30caa27" is_pre_election: true
I20260808 14:59:19.282220 1437 leader_election.cc:302] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4842b66ea24c4dcea394d1fc3511049c, 975d2477dc1b41daaea5eaa5a9bfa629; no voters:
I20260808 14:59:19.282325 2020 raft_consensus.cc:2454] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4842b66ea24c4dcea394d1fc3511049c in term 0.
I20260808 14:59:19.282666 2150 raft_consensus.cc:2781] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:59:19.282823 2150 raft_consensus.cc:482] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:59:19.282948 2150 raft_consensus.cc:3037] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:19.286250 2150 raft_consensus.cc:504] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4842b66ea24c4dcea394d1fc3511049c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 41779 } } peers { permanent_uuid: "56857166d62445538f41fafaa30caa27" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43579 } } peers { permanent_uuid: "975d2477dc1b41daaea5eaa5a9bfa629" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 45455 } }
I20260808 14:59:19.286927 2150 leader_election.cc:288] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [CANDIDATE]: Term 1 election: Requested vote from peers 56857166d62445538f41fafaa30caa27 (127.12.73.131:43579), 975d2477dc1b41daaea5eaa5a9bfa629 (127.12.73.130:45455)
I20260808 14:59:19.287393 2020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f7c8d22c5448b19b4a8be39a5878ec" candidate_uuid: "4842b66ea24c4dcea394d1fc3511049c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56857166d62445538f41fafaa30caa27"
I20260808 14:59:19.287443 1784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f7c8d22c5448b19b4a8be39a5878ec" candidate_uuid: "4842b66ea24c4dcea394d1fc3511049c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975d2477dc1b41daaea5eaa5a9bfa629"
I20260808 14:59:19.287588 2020 raft_consensus.cc:3037] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:19.287611 1784 raft_consensus.cc:3037] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:19.289927 1784 raft_consensus.cc:2454] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4842b66ea24c4dcea394d1fc3511049c in term 1.
I20260808 14:59:19.290349 1437 leader_election.cc:302] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4842b66ea24c4dcea394d1fc3511049c, 975d2477dc1b41daaea5eaa5a9bfa629; no voters:
I20260808 14:59:19.290629 2150 raft_consensus.cc:2781] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:59:19.291162 2150 raft_consensus.cc:686] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 1 LEADER]: Becoming Leader. State: Replica: 4842b66ea24c4dcea394d1fc3511049c, State: Running, Role: LEADER
I20260808 14:59:19.291231 2020 raft_consensus.cc:2454] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4842b66ea24c4dcea394d1fc3511049c in term 1.
I20260808 14:59:19.291749 2150 consensus_queue.cc:237] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4842b66ea24c4dcea394d1fc3511049c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 41779 } } peers { permanent_uuid: "56857166d62445538f41fafaa30caa27" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43579 } } peers { permanent_uuid: "975d2477dc1b41daaea5eaa5a9bfa629" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 45455 } }
W20260808 14:59:19.296875 1875 tablet.cc:2369] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:59:19.296769 1311 catalog_manager.cc:5495] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4842b66ea24c4dcea394d1fc3511049c (127.12.73.129). New cstate: current_term: 1 leader_uuid: "4842b66ea24c4dcea394d1fc3511049c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4842b66ea24c4dcea394d1fc3511049c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 41779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56857166d62445538f41fafaa30caa27" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "975d2477dc1b41daaea5eaa5a9bfa629" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 45455 } health_report { overall_health: UNKNOWN } } }
I20260808 14:59:19.328517 2129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.322846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52442 (local address 127.12.73.129:41779)
0808 14:59:19.323057 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:19.323063 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:19.323169 (+ 106us) server_negotiation.cc:407] Connection header received
0808 14:59:19.323424 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:19.323428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:19.323505 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:19.323659 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:59:19.324050 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.324831 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.326379 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.326776 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.326913 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.327427 (+ 514us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:59:19.327923 (+ 496us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:59:19.328099 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:19.328160 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 14:59:19.328253 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:59:19.337864 2020 raft_consensus.cc:1261] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27 [term 1 FOLLOWER]: Refusing update from remote peer 4842b66ea24c4dcea394d1fc3511049c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:59:19.337939 1784 raft_consensus.cc:1261] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629 [term 1 FOLLOWER]: Refusing update from remote peer 4842b66ea24c4dcea394d1fc3511049c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:59:19.338900 2153 consensus_queue.cc:1035] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [LEADER]: Connected to new peer: Peer: permanent_uuid: "56857166d62445538f41fafaa30caa27" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:59:19.339325 2150 consensus_queue.cc:1035] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [LEADER]: Connected to new peer: Peer: permanent_uuid: "975d2477dc1b41daaea5eaa5a9bfa629" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 45455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:59:19.352561 2160 mvcc.cc:205] Tried to move back new op lower bound from 7316279948637503488 to 7316279948463173632. Current Snapshot: MvccSnapshot[applied={T|T < 7316279948637503488}]
I20260808 14:59:19.377033 1311 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:59:19.377358 1311 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:59:19.381542 1311 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 823dd3c5a34a4c0ba8a0ca36c5a4f952: Sending DeleteTablet for 3 replicas of tablet e1f7c8d22c5448b19b4a8be39a5878ec
I20260808 14:59:19.383114 1509 tablet_service.cc:1514] Processing DeleteTablet for tablet e1f7c8d22c5448b19b4a8be39a5878ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:59:19 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:52432
I20260808 14:59:19.383764 1746 tablet_service.cc:1514] Processing DeleteTablet for tablet e1f7c8d22c5448b19b4a8be39a5878ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:59:19 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:33402
I20260808 14:59:19.385109 1995 tablet_service.cc:1514] Processing DeleteTablet for tablet e1f7c8d22c5448b19b4a8be39a5878ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:59:19 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:40592
I20260808 14:59:19.393550 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 1375
I20260808 14:59:19.401660 2172 tablet_replica.cc:330] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c: stopping tablet replica
I20260808 14:59:19.402318 2173 tablet_replica.cc:330] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629: stopping tablet replica
I20260808 14:59:19.402803 2172 raft_consensus.cc:2229] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:59:19.403632 2172 raft_consensus.cc:2258] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:59:19.404244 2175 tablet_replica.cc:330] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27: stopping tablet replica
I20260808 14:59:19.404714 2173 raft_consensus.cc:2229] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:59:19.405277 2173 raft_consensus.cc:2258] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:59:19.405757 2175 raft_consensus.cc:2229] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:59:19.408102 2172 ts_tablet_manager.cc:1905] T e1f7c8d22c5448b19b4a8be39a5878ec P 4842b66ea24c4dcea394d1fc3511049c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:19.408310 2173 ts_tablet_manager.cc:1905] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:19.408684 2175 raft_consensus.cc:2258] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:59:19.414366 2129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.394378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52448 (local address 127.12.73.129:41779)
0808 14:59:19.394555 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:19.394563 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:19.394639 (+ 76us) server_negotiation.cc:407] Connection header received
0808 14:59:19.394834 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:19.394840 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:19.394939 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:19.395063 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:19.396710 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.398243 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.399532 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.400429 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.400570 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.404929 (+ 4359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:19.404944 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:19.404965 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:19.405011 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:19.409712 (+ 4701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:19.410695 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:19.410703 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:19.410706 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:19.410903 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:19.411382 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:19.411387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:19.411391 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:19.411803 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:19.413605 (+ 1802us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:19.413761 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 14:59:19.413999 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:59:19.415010 1610 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:19.415951 2175 ts_tablet_manager.cc:1905] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:19.419597 2173 ts_tablet_manager.cc:1918] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:59:19.419770 2173 log.cc:1196] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/e1f7c8d22c5448b19b4a8be39a5878ec
I20260808 14:59:19.420233 2173 ts_tablet_manager.cc:1939] T e1f7c8d22c5448b19b4a8be39a5878ec P 975d2477dc1b41daaea5eaa5a9bfa629: Deleting consensus metadata
I20260808 14:59:19.422194 1291 catalog_manager.cc:4841] TS 975d2477dc1b41daaea5eaa5a9bfa629 (127.12.73.130:45455): tablet e1f7c8d22c5448b19b4a8be39a5878ec (table test-table [id=285ec8d31732447c95db1e32adfd0821]) successfully deleted
I20260808 14:59:19.423408 2175 ts_tablet_manager.cc:1918] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:59:19.423561 2175 log.cc:1196] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/e1f7c8d22c5448b19b4a8be39a5878ec
I20260808 14:59:19.424052 2175 ts_tablet_manager.cc:1939] T e1f7c8d22c5448b19b4a8be39a5878ec P 56857166d62445538f41fafaa30caa27: Deleting consensus metadata
I20260808 14:59:19.425829 1292 catalog_manager.cc:4841] TS 56857166d62445538f41fafaa30caa27 (127.12.73.131:43579): tablet e1f7c8d22c5448b19b4a8be39a5878ec (table test-table [id=285ec8d31732447c95db1e32adfd0821]) successfully deleted
I20260808 14:59:19.512260 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 1375
W20260808 14:59:19.537436 1291 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.73.129:41779 (error 108)
I20260808 14:59:19.537765 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 1625
I20260808 14:59:19.539590 2126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.539055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:41779 (local address 127.0.0.1:52462)
0808 14:59:19.539235 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.539380 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:41779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 14:59:19.539830 1291 catalog_manager.cc:4584] TS 4842b66ea24c4dcea394d1fc3511049c (127.12.73.129:41779): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e1f7c8d22c5448b19b4a8be39a5878ec: Network error: Client connection negotiation failed: client connection to 127.12.73.129:41779: connect: Connection refused (error 111)
I20260808 14:59:19.551249 2130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.538575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33416 (local address 127.12.73.130:45455)
0808 14:59:19.538760 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:19.538764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:19.538940 (+ 176us) server_negotiation.cc:407] Connection header received
0808 14:59:19.539095 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:19.539101 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:19.539200 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:19.539298 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:19.540821 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.541594 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.542863 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.543230 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.543316 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.546078 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:19.546091 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:19.546106 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:19.546141 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:19.548830 (+ 2689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:19.549554 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:19.549560 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:19.549562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:19.549700 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:19.550011 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:19.550014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:19.550016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:19.550350 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:19.550568 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:19.550814 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 14:59:19.550977 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:59:19.551906 1865 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:19.593665 2126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.593189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:41779 (local address 127.0.0.1:52466)
0808 14:59:19.593389 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.593502 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:41779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 14:59:19.594724 2126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.594366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:41779 (local address 127.0.0.1:52482)
0808 14:59:19.594524 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.594595 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:41779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 14:59:19.643391 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 1625
I20260808 14:59:19.655194 2126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.654577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:41779 (local address 127.0.0.1:52492)
0808 14:59:19.654838 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.654968 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:41779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 14:59:19.656354 2126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.655877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:41779 (local address 127.0.0.1:52500)
0808 14:59:19.656082 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.656193 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:41779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 14:59:19.670593 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 1880
I20260808 14:59:19.684226 2128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.671330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40602 (local address 127.12.73.131:43579)
0808 14:59:19.671484 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:19.671488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:19.671519 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:59:19.671643 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:19.671647 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:19.671711 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:19.671805 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:19.673077 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.673876 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.675215 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:19.675603 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:19.675705 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:19.678316 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:19.678332 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:19.678350 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:19.678380 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:19.681863 (+ 3483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:19.682535 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:19.682543 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:19.682545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:19.682692 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:19.682994 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:19.682997 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:19.682999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:19.683358 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:19.683580 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:19.683797 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 14:59:19.683961 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:59:19.684928 2087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:19.737527 2126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.737014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:41779 (local address 127.0.0.1:52514)
0808 14:59:19.737251 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.737342 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:41779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 14:59:19.738538 2126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.738167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:41779 (local address 127.0.0.1:52526)
0808 14:59:19.738357 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.738433 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:41779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 14:59:19.774982 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 1880
I20260808 14:59:19.802597 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 1262
I20260808 14:59:19.803804 1362 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:19.916800 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 1262
I20260808 14:59:19.916898 2126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:19.916375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:41779 (local address 127.0.0.1:52542)
0808 14:59:19.916609 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:19.916715 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:41779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260808 14:59:19.954118 12582 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 14:59:20.300160 12582 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 14:59:20.300420 12582 mini_ranger.cc:66] Stopping Ranger...
I20260808 14:59:20.646176 12582 mini_ranger.cc:68] Stopped Ranger
2026-08-08 14:59:20.646 UTC [32253] LOG: received smart shutdown request
2026-08-08 14:59:20.649 UTC [32253] LOG: background worker "logical replication launcher" (PID 32266) exited with exit code 1
2026-08-08 14:59:20.649 UTC [32258] LOG: shutting down
2026-08-08 14:59:20.809 UTC [32253] LOG: database system is shut down
2026-08-08T14:59:20Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (53165 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:59:21 dist-test-slave-z8x9 krb5kdc[2197](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:59:21 dist-test-slave-z8x9 krb5kdc[2197](info): set up 2 sockets
Aug 08 14:59:21 dist-test-slave-z8x9 krb5kdc[2197](info): commencing operation
krb5kdc: starting...
W20260808 14:59:22.300428 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.003s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:59:22 dist-test-slave-z8x9 krb5kdc[2197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:59:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:59:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:59:22.577639 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33809
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:38283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:33809,127.12.73.189:37707,127.12.73.188:44951
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:22.916900 2223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:22.917346 2223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:22.917549 2223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:22.924786 2223 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:59:22.924880 2223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:22.924975 2223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:22.925084 2223 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:59:22.925170 2223 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:59:22.934705 2223 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:38283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:33809,127.12.73.189:37707,127.12.73.188:44951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:22.936303 2223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:22.937691 2223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:22.949388 2230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:22.949357 2231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:22.949425 2233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:22.950395 2223 server_base.cc:1034] running on GCE node
I20260808 14:59:22.951120 2223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:22.952436 2223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:22.953637 2223 hybrid_clock.cc:648] HybridClock initialized: now 1786201162953585 us; error 53 us; skew 500 ppm
I20260808 14:59:22.953985 2223 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:22 dist-test-slave-z8x9 krb5kdc[2197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:22.957056 2223 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:59:22.958456 2223 webserver.cc:460] Webserver started at http://127.12.73.190:36449/ using document root <none> and password file <none>
I20260808 14:59:22.959081 2223 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:22.959182 2223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:22.959426 2223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:59:22.962337 2223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "85b16887ecc84f2782f3c80ed657a94e"
format_stamp: "Formatted at 2026-08-08 14:59:22 on dist-test-slave-z8x9"
server_key: "47defb5505c61eedb069f8cd63a769b7"
server_key_iv: "d014624a57fc895146a5daad90e6591a"
server_key_version: "encryptionkey@0"
I20260808 14:59:22.963160 2223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "85b16887ecc84f2782f3c80ed657a94e"
format_stamp: "Formatted at 2026-08-08 14:59:22 on dist-test-slave-z8x9"
server_key: "47defb5505c61eedb069f8cd63a769b7"
server_key_iv: "d014624a57fc895146a5daad90e6591a"
server_key_version: "encryptionkey@0"
I20260808 14:59:22.968036 2223 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 14:59:22.971338 2241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:22.972656 2223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:59:22.972822 2223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "85b16887ecc84f2782f3c80ed657a94e"
format_stamp: "Formatted at 2026-08-08 14:59:22 on dist-test-slave-z8x9"
server_key: "47defb5505c61eedb069f8cd63a769b7"
server_key_iv: "d014624a57fc895146a5daad90e6591a"
server_key_version: "encryptionkey@0"
I20260808 14:59:22.973026 2223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:22.991616 2223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:22.995671 2223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:22.996104 2223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:23.015359 2223 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:33809
I20260808 14:59:23.015395 2328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:33809 every 8 connection(s)
I20260808 14:59:23.016733 2223 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:59:23.020285 2330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:23.023874 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 2223
I20260808 14:59:23.024120 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:59:23.024966 12582 external_mini_cluster.cc:1428] Setting key 6df4d17f2fec34c79a43d2e7498d439d
I20260808 14:59:23.028944 2330 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:59:23 dist-test-slave-z8x9 krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.73.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.189@KRBTEST.COM" created.
I20260808 14:59:23.058645 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.032856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38334 (local address 127.12.73.190:33809)
0808 14:59:23.039419 (+ 6563us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:23.039425 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:23.039465 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:59:23.041091 (+ 1626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:23.041096 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:23.041379 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:23.041538 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:23.043230 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.044427 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.046701 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.047223 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.047347 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:23.051298 (+ 3951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:23.051306 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:23.051317 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:23.051349 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:23.054263 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:23.054939 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:23.054945 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:23.054948 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:23.055101 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:23.055495 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:23.055504 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:23.055506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:23.056009 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:23.056217 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:23.056833 (+ 616us) server_negotiation.cc:299] Negotiation successful
0808 14:59:23.057174 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":6381,"thread_start_us":6131,"threads_started":1}
I20260808 14:59:23.058662 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.032854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33809 (local address 127.0.0.1:38334)
0808 14:59:23.037742 (+ 4888us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.037796 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:23.040732 (+ 2936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:23.041614 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:23.041624 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:23.042502 (+ 878us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:23.043017 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:23.043043 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.044585 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.044593 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:23.046560 (+ 1967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:23.046578 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.047472 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.047482 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:23.047699 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:23.048404 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:23.048438 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:23.051077 (+ 2639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:23.054389 (+ 3312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:23.054402 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:23.054412 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:23.054805 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:23.055218 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:23.055223 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:23.055226 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:23.055384 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:23.056165 (+ 781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:23.056173 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:23.056415 (+ 242us) client_negotiation.cc:769] Sending connection context
0808 14:59:23.056713 (+ 298us) client_negotiation.cc:240] Negotiation successful
0808 14:59:23.057341 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4614,"mutex_wait_us":161,"thread_start_us":4405,"threads_started":1}
I20260808 14:59:23.061480 2330 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:59:23.062575 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.062197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45340)
0808 14:59:23.062361 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.062470 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 14:59:23.062842 2245 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
I20260808 14:59:23.064374 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.064027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45354)
0808 14:59:23.064170 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.064248 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:59:23.064581 2330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:37707: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.189.keytab.
Entry for principal kudu/127.12.73.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.189.keytab.
I20260808 14:59:23.092684 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.189:37707
--webserver_interface=127.12.73.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.189.keytab
--principal=kudu/127.12.73.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:38283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:33809,127.12.73.189:37707,127.12.73.188:44951
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:59:23.113930 2330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } attempt: 1
I20260808 14:59:23.115170 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.114702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45370)
0808 14:59:23.114915 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.115038 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 14:59:23.116185 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.115798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45386)
0808 14:59:23.115945 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.116023 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 14:59:23.116370 2330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:37707: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
I20260808 14:59:23.184629 2330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } attempt: 2
I20260808 14:59:23.185846 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.185364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45390)
0808 14:59:23.185608 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.185704 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 14:59:23.186786 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.186440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45394)
0808 14:59:23.186606 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.186667 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 14:59:23.186975 2330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:37707: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
I20260808 14:59:23.278208 2330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } attempt: 3
I20260808 14:59:23.279309 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.278868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45396)
0808 14:59:23.279075 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.279180 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 14:59:23.280282 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.279939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45408)
0808 14:59:23.280081 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.280152 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:59:23.280469 2330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:37707: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
I20260808 14:59:23.423698 2330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } attempt: 4
I20260808 14:59:23.424911 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.424383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45412)
0808 14:59:23.424682 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.424767 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260808 14:59:23.425858 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.425524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45420)
0808 14:59:23.425660 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.425737 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 14:59:23.426031 2330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:37707: Network error: Client connection negotiation failed: client connection to 127.12.73.189:37707: connect: Connection refused (error 111)
W20260808 14:59:23.426044 2344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:23.426409 2344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:23.426571 2344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:23.434006 2344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:59:23.434157 2344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:23.434264 2344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:23.434371 2344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:59:23.434450 2344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:59:23.444897 2344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:38283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:33809,127.12.73.189:37707,127.12.73.188:44951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.189.keytab
--principal=kudu/127.12.73.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.189:37707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.73.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:23.446266 2344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:23.447566 2344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:23.459062 2356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:23.459108 2352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:23.459229 2353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:23.462555 2344 server_base.cc:1034] running on GCE node
I20260808 14:59:23.463265 2344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:23.464511 2344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:23.465739 2344 hybrid_clock.cc:648] HybridClock initialized: now 1786201163465695 us; error 27 us; skew 500 ppm
I20260808 14:59:23.466046 2344 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:23 dist-test-slave-z8x9 krb5kdc[2197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:23.469410 2344 init.cc:377] Logged in from keytab as kudu/127.12.73.189@KRBTEST.COM (short username kudu)
I20260808 14:59:23.471001 2344 webserver.cc:460] Webserver started at http://127.12.73.189:44635/ using document root <none> and password file <none>
I20260808 14:59:23.471715 2344 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:23.471849 2344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:23.472164 2344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:59:23.475154 2344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/data/instance:
uuid: "1f30af5dd10f46759e7f3d2dabff7beb"
format_stamp: "Formatted at 2026-08-08 14:59:23 on dist-test-slave-z8x9"
server_key: "12b3daad8550d68b592bcfa66046fc2d"
server_key_iv: "4d2fa6f6455bc8fc12f8d1ffb1a35da9"
server_key_version: "encryptionkey@0"
I20260808 14:59:23.475957 2344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/wal/instance:
uuid: "1f30af5dd10f46759e7f3d2dabff7beb"
format_stamp: "Formatted at 2026-08-08 14:59:23 on dist-test-slave-z8x9"
server_key: "12b3daad8550d68b592bcfa66046fc2d"
server_key_iv: "4d2fa6f6455bc8fc12f8d1ffb1a35da9"
server_key_version: "encryptionkey@0"
I20260808 14:59:23.481225 2344 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 14:59:23.484481 2368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:23.485812 2344 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:59:23.485985 2344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/wal
uuid: "1f30af5dd10f46759e7f3d2dabff7beb"
format_stamp: "Formatted at 2026-08-08 14:59:23 on dist-test-slave-z8x9"
server_key: "12b3daad8550d68b592bcfa66046fc2d"
server_key_iv: "4d2fa6f6455bc8fc12f8d1ffb1a35da9"
server_key_version: "encryptionkey@0"
I20260808 14:59:23.486168 2344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:23.506227 2344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:23.510524 2344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:23.510808 2344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:23.529279 2344 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.189:37707
I20260808 14:59:23.529281 2450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.189:37707 every 8 connection(s)
I20260808 14:59:23.530646 2344 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
I20260808 14:59:23.534296 2451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:23.540453 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 2344
I20260808 14:59:23.540665 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-1/wal/instance
I20260808 14:59:23.541258 12582 external_mini_cluster.cc:1428] Setting key 3899f087af7afca17301e58c4a6cd607
I20260808 14:59:23.540714 2451 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:59:23 dist-test-slave-z8x9 krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.189@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:23.562147 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.543962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38348 (local address 127.12.73.190:33809)
0808 14:59:23.544187 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:23.544193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:23.545485 (+ 1292us) server_negotiation.cc:407] Connection header received
0808 14:59:23.547342 (+ 1857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:23.547352 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:23.547450 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:23.547571 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:23.548988 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.550081 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.551556 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.552303 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.552451 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:23.556529 (+ 4078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:23.556534 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:23.556537 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:23.556569 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:23.559242 (+ 2673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:23.559933 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:23.559939 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:23.559943 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:23.560065 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:23.560472 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:23.560478 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:23.560481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:23.560747 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:23.560906 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:23.561604 (+ 698us) server_negotiation.cc:299] Negotiation successful
0808 14:59:23.561824 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:59:23.563048 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.544439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33809 (local address 127.0.0.1:38348)
0808 14:59:23.545320 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.545366 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:23.547070 (+ 1704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:23.547763 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:23.547770 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:23.548278 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:23.548792 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:23.548808 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.550229 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.550232 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:23.551404 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:23.551415 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.552499 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.552503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:23.552842 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:23.553668 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:23.553699 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:23.556305 (+ 2606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:23.559386 (+ 3081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:23.559394 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:23.559408 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:23.559811 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:23.560174 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:23.560179 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:23.560182 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:23.560364 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:23.560871 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:23.560879 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:23.561236 (+ 357us) client_negotiation.cc:769] Sending connection context
0808 14:59:23.561505 (+ 269us) client_negotiation.cc:240] Negotiation successful
0808 14:59:23.561966 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":410,"threads_started":1}
I20260808 14:59:23.564678 2451 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.73.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.188@KRBTEST.COM" created.
Aug 08 14:59:23 dist-test-slave-z8x9 krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.189@KRBTEST.COM for kudu/127.12.73.189@KRBTEST.COM
I20260808 14:59:23.579128 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.565569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45428)
0808 14:59:23.565715 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.565730 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:23.565804 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:23.566868 (+ 1064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:23.566872 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:23.567289 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:23.567412 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:23.567420 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.568742 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.568750 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:23.569619 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:23.569631 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.570433 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.570439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:23.570739 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:23.571431 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:23.571448 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:23.573369 (+ 1921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:23.576459 (+ 3090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:23.576467 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:23.576475 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:23.576931 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:23.577340 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:23.577345 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:23.577349 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:23.577503 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:23.578126 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:23.578132 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:23.578280 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 14:59:23.578435 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 14:59:23.578709 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":55}
I20260808 14:59:23.579205 2457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.565889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45428 (local address 127.12.73.189:37707)
0808 14:59:23.566506 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:23.566512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:23.566536 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:59:23.566574 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:23.566580 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:23.566730 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:23.566883 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:23.567562 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.568619 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.569778 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.570296 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.570435 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:23.573556 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:23.573566 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:23.573578 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:23.573608 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:23.576343 (+ 2735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:23.577060 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:23.577067 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:23.577069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:23.577236 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:23.577602 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:23.577608 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:23.577611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:23.578014 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:23.578230 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:23.578612 (+ 382us) server_negotiation.cc:299] Negotiation successful
0808 14:59:23.578813 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":483,"thread_start_us":360,"threads_started":1}
I20260808 14:59:23.581621 2451 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:59:23.582960 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.582383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56384)
0808 14:59:23.582604 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.582733 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 14:59:23.583250 2371 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
I20260808 14:59:23.584885 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.584459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56394)
0808 14:59:23.584632 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.584733 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 14:59:23.585124 2451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:44951: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.188.keytab.
Entry for principal kudu/127.12.73.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.188.keytab.
I20260808 14:59:23.602777 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.188:44951
--webserver_interface=127.12.73.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.188.keytab
--principal=kudu/127.12.73.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:38283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:33809,127.12.73.189:37707,127.12.73.188:44951
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:59:23.634505 2451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } attempt: 1
I20260808 14:59:23.635738 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.635260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56402)
0808 14:59:23.635460 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.635569 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 14:59:23.636724 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.636378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56418)
0808 14:59:23.636547 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.636612 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:59:23.636936 2451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:44951: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
I20260808 14:59:23.705199 2451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } attempt: 2
I20260808 14:59:23.706389 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.705895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56424)
0808 14:59:23.706109 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.706214 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 14:59:23.707513 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.707103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56438)
0808 14:59:23.707304 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.707385 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260808 14:59:23.707752 2451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:44951: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
I20260808 14:59:23.725296 2330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } attempt: 5
Aug 08 14:59:23 dist-test-slave-z8x9 krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for kudu/127.12.73.189@KRBTEST.COM
I20260808 14:59:23.741479 2457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.726162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45444 (local address 127.12.73.189:37707)
0808 14:59:23.726341 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:23.726348 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:23.726373 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:59:23.726512 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:23.726520 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:23.726639 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:23.726785 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:23.727578 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.728847 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.730063 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.730771 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.730906 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:23.734299 (+ 3393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:23.734306 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:23.734311 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:23.734351 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:23.737984 (+ 3633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:23.739004 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:23.739016 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:23.739021 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:23.739262 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:23.739764 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:23.739770 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:23.739775 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:23.740209 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:23.740358 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:23.740905 (+ 547us) server_negotiation.cc:299] Negotiation successful
0808 14:59:23.741140 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:59:23.741544 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.726054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45444)
0808 14:59:23.726246 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.726267 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:23.726380 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:23.726829 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:23.726832 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:23.727207 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:23.727387 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:23.727407 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.729003 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.729007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:23.729911 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:23.729923 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:23.730946 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:23.730951 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:23.731082 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:23.731739 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:23.731757 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:23.734086 (+ 2329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:23.738159 (+ 4073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:23.738165 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:23.738169 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:23.738795 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:23.739409 (+ 614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:23.739414 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:23.739418 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:23.739632 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:23.740344 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:23.740350 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:23.740578 (+ 228us) client_negotiation.cc:769] Sending connection context
0808 14:59:23.740766 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 14:59:23.741094 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 14:59:23.743016 2330 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:59:23.744269 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.743822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56448)
0808 14:59:23.744001 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.744097 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 14:59:23.745527 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.745093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56458)
0808 14:59:23.745322 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.745423 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
W20260808 14:59:23.745810 2330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:44951: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
I20260808 14:59:23.797073 2330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } attempt: 1
I20260808 14:59:23.798452 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.797927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56462)
0808 14:59:23.798155 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.798283 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 14:59:23.798970 2451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } attempt: 3
I20260808 14:59:23.799670 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.799247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56470)
0808 14:59:23.799432 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.799526 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 14:59:23.799886 2330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:44951: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
I20260808 14:59:23.800125 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.799540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56484)
0808 14:59:23.799782 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.799904 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 14:59:23.801421 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.800816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56498)
0808 14:59:23.801087 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.801234 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
W20260808 14:59:23.801710 2451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:44951: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
I20260808 14:59:23.868145 2330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } attempt: 2
I20260808 14:59:23.869468 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.868829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56514)
0808 14:59:23.869105 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.869260 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 14:59:23.870610 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.870180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56516)
0808 14:59:23.870373 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.870459 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260808 14:59:23.870857 2330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:44951: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
W20260808 14:59:23.944607 2461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:23.944958 2461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:23.945142 2461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 14:59:23.945030 2451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } attempt: 4
I20260808 14:59:23.946206 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.945740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56532)
0808 14:59:23.945960 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.946046 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 14:59:23.947253 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.946870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56546)
0808 14:59:23.947032 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.947117 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 14:59:23.947502 2451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:44951: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
W20260808 14:59:23.953109 2461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:59:23.953269 2461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:23.953339 2461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:23.953402 2461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:59:23.953449 2461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:59:23.963394 2461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:38283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:33809,127.12.73.189:37707,127.12.73.188:44951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.188.keytab
--principal=kudu/127.12.73.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.188:44951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.73.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:23.964643 2461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:23.965931 2461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:59:23.977077 2330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } attempt: 3
W20260808 14:59:23.977456 2471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:23.977854 2466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:23.978084 2475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:23.978497 2461 server_base.cc:1034] running on GCE node
I20260808 14:59:23.978572 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.977767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56560)
0808 14:59:23.978250 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.978326 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323}
I20260808 14:59:23.979352 2461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:23.979576 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:23.979160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56568)
0808 14:59:23.979358 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:23.979447 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260808 14:59:23.979843 2330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:44951: Network error: Client connection negotiation failed: client connection to 127.12.73.188:44951: connect: Connection refused (error 111)
I20260808 14:59:23.980803 2461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:23.982021 2461 hybrid_clock.cc:648] HybridClock initialized: now 1786201163981982 us; error 49 us; skew 500 ppm
I20260808 14:59:23.982378 2461 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:23 dist-test-slave-z8x9 krb5kdc[2197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:23.985582 2461 init.cc:377] Logged in from keytab as kudu/127.12.73.188@KRBTEST.COM (short username kudu)
I20260808 14:59:23.987010 2461 webserver.cc:460] Webserver started at http://127.12.73.188:33415/ using document root <none> and password file <none>
I20260808 14:59:23.987702 2461 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:23.987818 2461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:23.988049 2461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:59:23.991186 2461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/data/instance:
uuid: "a13241decb2c489dbf2ff5b7e57fa3f3"
format_stamp: "Formatted at 2026-08-08 14:59:23 on dist-test-slave-z8x9"
server_key: "8054c06ee784bd852f55eb27677e1ed3"
server_key_iv: "bca669bad605dc635812a9cbe7e0a766"
server_key_version: "encryptionkey@0"
I20260808 14:59:23.991921 2461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/wal/instance:
uuid: "a13241decb2c489dbf2ff5b7e57fa3f3"
format_stamp: "Formatted at 2026-08-08 14:59:23 on dist-test-slave-z8x9"
server_key: "8054c06ee784bd852f55eb27677e1ed3"
server_key_iv: "bca669bad605dc635812a9cbe7e0a766"
server_key_version: "encryptionkey@0"
I20260808 14:59:23.996806 2461 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:59:24.000216 2490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:24.001554 2461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:59:24.001725 2461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/wal
uuid: "a13241decb2c489dbf2ff5b7e57fa3f3"
format_stamp: "Formatted at 2026-08-08 14:59:23 on dist-test-slave-z8x9"
server_key: "8054c06ee784bd852f55eb27677e1ed3"
server_key_iv: "bca669bad605dc635812a9cbe7e0a766"
server_key_version: "encryptionkey@0"
I20260808 14:59:24.001899 2461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:24.024614 2461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:24.028739 2461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:24.029043 2461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:24.047544 2461 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.188:44951
I20260808 14:59:24.047576 2574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.188:44951 every 8 connection(s)
I20260808 14:59:24.048801 2461 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
I20260808 14:59:24.052290 2576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:24.058893 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 2461
I20260808 14:59:24.059087 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200952883082-12582-0/minicluster-data/master-2/wal/instance
I20260808 14:59:24.058714 2576 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:59:24.059721 12582 external_mini_cluster.cc:1428] Setting key aa7eea44cdae97af057fc10d4d5434f9
Aug 08 14:59:24 dist-test-slave-z8x9 krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.188@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
Aug 08 14:59:24 dist-test-slave-z8x9 krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.188@KRBTEST.COM
I20260808 14:59:24.079866 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.061744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38352 (local address 127.12.73.190:33809)
0808 14:59:24.061967 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:24.061974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:24.063037 (+ 1063us) server_negotiation.cc:407] Connection header received
0808 14:59:24.064545 (+ 1508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:24.064551 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:24.064631 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:24.064742 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:24.066579 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.067247 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.068755 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.069307 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.069404 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.072888 (+ 3484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:24.072893 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:24.072896 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:24.072946 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:24.076568 (+ 3622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.077467 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.077473 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.077476 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.077654 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.078084 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.078087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.078089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.078336 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:24.078443 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:24.079252 (+ 809us) server_negotiation.cc:299] Negotiation successful
0808 14:59:24.079476 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:59:24.080765 2582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.061894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33809 (local address 127.0.0.1:38352)
0808 14:59:24.062866 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:24.062906 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:24.064295 (+ 1389us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:24.065310 (+ 1015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:24.065315 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:24.065853 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:24.066388 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:24.066413 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.067395 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.067400 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:24.068604 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:24.068620 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.069527 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.069537 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:24.069693 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.070450 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:24.070475 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:24.072684 (+ 2209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:24.076695 (+ 4011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:24.076704 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:24.076711 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:24.077357 (+ 646us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:24.077765 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:24.077768 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:24.077771 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:24.077948 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:24.078462 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:24.078470 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:24.078822 (+ 352us) client_negotiation.cc:769] Sending connection context
0808 14:59:24.079144 (+ 322us) client_negotiation.cc:240] Negotiation successful
0808 14:59:24.079489 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"thread_start_us":533,"threads_started":1}
I20260808 14:59:24.081440 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.061673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56582 (local address 127.12.73.188:44951)
0808 14:59:24.062629 (+ 956us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:24.062643 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:24.062680 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:59:24.064285 (+ 1605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:24.064305 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:24.064578 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:24.064789 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:24.066160 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.067517 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.068862 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.069492 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.069653 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.074040 (+ 4387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:24.074053 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:24.074071 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:24.074118 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:24.077910 (+ 3792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.078616 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.078622 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.078624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.078759 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.079157 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.079162 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.079165 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.079591 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:24.079890 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:24.080810 (+ 920us) server_negotiation.cc:299] Negotiation successful
0808 14:59:24.081043 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":488,"threads_started":1}
I20260808 14:59:24.082442 2576 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:59:24 dist-test-slave-z8x9 krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.188@KRBTEST.COM for kudu/127.12.73.189@KRBTEST.COM
Aug 08 14:59:24 dist-test-slave-z8x9 krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:24.095892 2457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.083212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45460 (local address 127.12.73.189:37707)
0808 14:59:24.083417 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:24.083424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:24.083579 (+ 155us) server_negotiation.cc:407] Connection header received
0808 14:59:24.083787 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:24.083792 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:24.083874 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:24.083984 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:24.084735 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.085473 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.086641 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.087040 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.087167 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.090095 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:24.090100 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:24.090104 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:24.090136 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:24.092988 (+ 2852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.093971 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.093978 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.093983 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.094168 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.094608 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.094612 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.094614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.094868 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:24.095042 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:24.095453 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 14:59:24.095611 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:59:24.096021 2582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.083237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:37707 (local address 127.0.0.1:45460)
0808 14:59:24.083477 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:24.083496 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:24.083610 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:24.084024 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:24.084030 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:24.084462 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:24.084593 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:24.084601 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.085600 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.085607 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:24.086487 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:24.086504 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.087172 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.087178 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:24.087381 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.087926 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:24.087942 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:24.089919 (+ 1977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:24.093160 (+ 3241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:24.093165 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:24.093169 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:24.093711 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:24.094288 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:24.094293 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:24.094296 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:24.094490 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:24.095005 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:24.095008 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:24.095203 (+ 195us) client_negotiation.cc:769] Sending connection context
0808 14:59:24.095370 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 14:59:24.095647 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20260808 14:59:24.096959 2576 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:59:24.099409 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.084332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38364 (local address 127.12.73.190:33809)
0808 14:59:24.084482 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:24.084490 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:24.084509 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:59:24.084682 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:24.084687 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:24.084748 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:24.084842 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:24.086046 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.086777 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.088201 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.088592 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.088725 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.093156 (+ 4431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:24.093162 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:24.093213 (+ 51us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:24.093257 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:24.096701 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.097457 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.097461 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.097463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.097636 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.098015 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.098020 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.098027 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.098279 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:24.098555 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:24.098858 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 14:59:24.099075 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 14:59:24 dist-test-slave-z8x9 krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.188@KRBTEST.COM for kudu/127.12.73.188@KRBTEST.COM
Aug 08 14:59:24 dist-test-slave-z8x9 krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.189@KRBTEST.COM
I20260808 14:59:24.110673 2582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.097664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56596)
0808 14:59:24.097907 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:24.097927 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:24.098039 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:24.098313 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:24.098317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:24.098685 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:24.098807 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:24.098815 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.099814 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.099821 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:24.100823 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:24.100838 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.101854 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.101857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:24.101982 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.102510 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:24.102531 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:24.105146 (+ 2615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:24.108272 (+ 3126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:24.108279 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:24.108283 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:24.108773 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:24.109118 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:24.109123 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:24.109126 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:24.109312 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:24.109947 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:24.109950 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:24.110065 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 14:59:24.110187 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 14:59:24.110400 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161}
I20260808 14:59:24.110954 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.097683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56596 (local address 127.12.73.188:44951)
0808 14:59:24.097842 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:24.097847 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:24.097989 (+ 142us) server_negotiation.cc:407] Connection header received
0808 14:59:24.098151 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:24.098155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:24.098212 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:24.098299 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:24.098951 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.099699 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.100971 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.101626 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.101700 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.105417 (+ 3717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:24.105423 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:24.105426 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:24.105455 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:24.108118 (+ 2663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.108889 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.108893 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.108896 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.109005 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.109432 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.109439 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.109442 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.109836 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:24.109993 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:24.110339 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 14:59:24.110573 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:59:24.116549 2576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3: Bootstrap starting.
I20260808 14:59:24.116588 2457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.100893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45462 (local address 127.12.73.189:37707)
0808 14:59:24.101054 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:24.101060 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:24.101075 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:59:24.101235 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:24.101241 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:24.101311 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:24.101402 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:24.102493 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.103617 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.105482 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.105898 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.106026 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.111166 (+ 5140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:24.111172 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:24.111176 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:24.111215 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:24.114063 (+ 2848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.114867 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.114871 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.114873 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.115001 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.115382 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.115385 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.115387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.115630 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:24.115818 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:24.116144 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 14:59:24.116301 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:59:24.120366 2576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:24.121490 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:59:24.121619 2576 log.cc:824] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:24.124459 2576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3: No bootstrap required, opened a new log
I20260808 14:59:24.139871 2576 raft_consensus.cc:348] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } }
I20260808 14:59:24.140471 2576 raft_consensus.cc:374] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:24.140676 2576 raft_consensus.cc:729] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13241decb2c489dbf2ff5b7e57fa3f3, State: Initialized, Role: FOLLOWER
I20260808 14:59:24.141640 2576 consensus_queue.cc:260] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } }
I20260808 14:59:24.148787 2596 sys_catalog.cc:455] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } } }
I20260808 14:59:24.151328 2596 sys_catalog.cc:458] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:59:24.151196 2576 sys_catalog.cc:564] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:59:24.157051 2330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } attempt: 4
I20260808 14:59:24.157522 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.127121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56604 (local address 127.12.73.188:44951)
0808 14:59:24.127325 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:24.127331 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:24.137961 (+ 10630us) server_negotiation.cc:407] Connection header received
0808 14:59:24.138198 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:24.138206 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:24.138307 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:24.138428 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:24.140911 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.142145 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.144373 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.145148 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.145279 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.149438 (+ 4159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:24.149447 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:24.149453 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:24.149497 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:24.153523 (+ 4026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.154161 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.154168 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.154172 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.154308 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.154778 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.154783 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.154787 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.155218 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:24.156377 (+ 1159us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:24.156502 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 14:59:24.156719 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:59:24.157832 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.126532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38370 (local address 127.12.73.190:33809)
0808 14:59:24.126713 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:24.126720 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:24.139251 (+ 12531us) server_negotiation.cc:407] Connection header received
0808 14:59:24.139771 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:24.139778 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:24.139867 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:24.139947 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:24.142288 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.143348 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.145742 (+ 2394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.146472 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.146581 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.150454 (+ 3873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:24.150464 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:24.150471 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:24.150529 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:24.154431 (+ 3902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.155360 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.155365 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.155368 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.155531 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.156018 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.156023 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.156026 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.156417 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:24.156634 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:24.157224 (+ 590us) server_negotiation.cc:299] Negotiation successful
0808 14:59:24.157463 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:59:24.163031 2457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.126813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45468 (local address 127.12.73.189:37707)
0808 14:59:24.132623 (+ 5810us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:24.132631 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:24.138699 (+ 6068us) server_negotiation.cc:407] Connection header received
0808 14:59:24.138920 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:24.138926 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:24.138999 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:24.139082 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:24.141343 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.142564 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.146138 (+ 3574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.147054 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.147202 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.151265 (+ 4063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:24.151273 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:24.151277 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:24.151325 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:24.157900 (+ 6575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.160345 (+ 2445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.160353 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.160360 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.160556 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.161094 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.161102 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.161107 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.161560 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:24.161809 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:24.162398 (+ 589us) server_negotiation.cc:299] Negotiation successful
0808 14:59:24.162625 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5648}
Aug 08 14:59:24 dist-test-slave-z8x9 krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for kudu/127.12.73.188@KRBTEST.COM
W20260808 14:59:24.173575 2616 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:59:24.173771 2616 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:59:24.175467 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.157620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56606)
0808 14:59:24.157984 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:24.158003 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:24.158095 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:24.158751 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:24.158755 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:24.159188 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:24.159385 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:24.159397 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.160743 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.160750 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:24.162080 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:24.162091 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.163256 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.163264 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:24.163450 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.164086 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:24.164107 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:24.166569 (+ 2462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:24.172361 (+ 5792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:24.172368 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:24.172372 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:24.172886 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:24.173479 (+ 593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:24.173485 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:24.173492 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:24.173670 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:24.174430 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:24.174438 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:24.174622 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 14:59:24.174782 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 14:59:24.175073 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237}
I20260808 14:59:24.175527 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.158284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56606 (local address 127.12.73.188:44951)
0808 14:59:24.158419 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:24.158425 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:24.158442 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:59:24.158496 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:24.158502 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:24.158569 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:24.158727 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:24.159510 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.160611 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.162211 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.162900 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.163059 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.166782 (+ 3723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:24.166790 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:24.166796 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:24.166835 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:24.170559 (+ 3724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.173075 (+ 2516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.173079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.173082 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.173324 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.173831 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.173836 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.173840 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.174290 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:24.174448 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:24.174897 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 14:59:24.175140 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:59:24.169749 2461 master_runner.cc:186] Error getting master registration for 127.12.73.190:33809: OK, instance_id { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" instance_seqno: 1786201163009986 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:59:24.181010 2461 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:59:24.181591 2330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e: Bootstrap starting.
I20260808 14:59:24.185760 2330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:24.187064 2330 log.cc:824] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:24.191284 2330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e: No bootstrap required, opened a new log
I20260808 14:59:24.202476 2330 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } }
I20260808 14:59:24.202872 2330 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:24.203023 2330 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b16887ecc84f2782f3c80ed657a94e, State: Initialized, Role: FOLLOWER
I20260808 14:59:24.203794 2330 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } }
I20260808 14:59:24.204982 2620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } } }
I20260808 14:59:24.205463 2620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:59:24.206321 2330 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [sys.catalog]: configured and running, proceeding with master startup.
W20260808 14:59:24.220034 2634 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:59:24.220271 2634 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:59:24.215644 2223 master_runner.cc:186] Error getting master registration for 127.12.73.189:37707: OK, instance_id { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" instance_seqno: 1786201163524038 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:59:24.227821 2223 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:59:24.246739 2451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } attempt: 5
W20260808 14:59:24.249192 2250 tablet.cc:2369] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 14:59:24 dist-test-slave-z8x9 krb5kdc[2197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.189@KRBTEST.COM for kudu/127.12.73.188@KRBTEST.COM
I20260808 14:59:24.261350 2596 raft_consensus.cc:482] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:59:24.261680 2596 raft_consensus.cc:504] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } }
I20260808 14:59:24.263391 2596 leader_election.cc:288] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b16887ecc84f2782f3c80ed657a94e (127.12.73.190:33809), 1f30af5dd10f46759e7f3d2dabff7beb (127.12.73.189:37707)
I20260808 14:59:24.264065 2291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b16887ecc84f2782f3c80ed657a94e" is_pre_election: true
I20260808 14:59:24.264683 2291 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13241decb2c489dbf2ff5b7e57fa3f3 in term 0.
I20260808 14:59:24.265942 2494 leader_election.cc:302] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b16887ecc84f2782f3c80ed657a94e, a13241decb2c489dbf2ff5b7e57fa3f3; no voters:
I20260808 14:59:24.266530 2596 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:59:24.266696 2596 raft_consensus.cc:482] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:59:24.266816 2596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:24.266809 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.247398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:44951 (local address 127.0.0.1:56622)
0808 14:59:24.247681 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:24.247702 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:24.247846 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:24.248217 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:24.248222 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:24.248768 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:24.249043 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:24.249056 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.250629 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.250634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:24.252092 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:24.252108 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.254384 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.254390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:24.254657 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.255477 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:24.255501 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:24.258399 (+ 2898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:24.262584 (+ 4185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:24.262609 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:24.262613 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:24.263236 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:24.264206 (+ 970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:24.264211 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:24.264216 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:24.264377 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:24.265121 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:24.265127 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:24.265324 (+ 197us) client_negotiation.cc:769] Sending connection context
0808 14:59:24.265508 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 14:59:24.265794 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145}
I20260808 14:59:24.269816 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:24.247471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56622 (local address 127.12.73.188:44951)
0808 14:59:24.247690 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:24.247697 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:24.247777 (+ 80us) server_negotiation.cc:407] Connection header received
0808 14:59:24.247981 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:24.247987 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:24.248064 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:24.248175 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:24.249260 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.250462 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.252280 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:24.253018 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:24.253140 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:24.258600 (+ 5460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:24.258609 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:24.258618 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:24.258675 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:24.262428 (+ 3753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.263858 (+ 1430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.263864 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.263868 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.264050 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:24.264521 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:24.264527 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:24.264530 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:24.264905 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:24.265056 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:24.266304 (+ 1248us) server_negotiation.cc:299] Negotiation successful
0808 14:59:24.266569 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 14:59:24.270334 2596 raft_consensus.cc:504] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } }
I20260808 14:59:24.273113 2291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b16887ecc84f2782f3c80ed657a94e"
I20260808 14:59:24.273382 2291 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:24.278143 2596 leader_election.cc:288] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [CANDIDATE]: Term 1 election: Requested vote from peers 85b16887ecc84f2782f3c80ed657a94e (127.12.73.190:33809), 1f30af5dd10f46759e7f3d2dabff7beb (127.12.73.189:37707)
I20260808 14:59:24.278088 2291 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13241decb2c489dbf2ff5b7e57fa3f3 in term 1.
I20260808 14:59:24.278477 2451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb: Bootstrap starting.
I20260808 14:59:24.279071 2494 leader_election.cc:302] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b16887ecc84f2782f3c80ed657a94e, a13241decb2c489dbf2ff5b7e57fa3f3; no voters:
I20260808 14:59:24.279605 2596 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [term 1 FOLLOWER]: Leader election won for term 1
W20260808 14:59:24.281057 2498 tablet.cc:2369] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:59:24.282687 2451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:24.283995 2451 log.cc:824] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:24.293572 2451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb: No bootstrap required, opened a new log
I20260808 14:59:24.296223 2596 raft_consensus.cc:686] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [term 1 LEADER]: Becoming Leader. State: Replica: a13241decb2c489dbf2ff5b7e57fa3f3, State: Running, Role: LEADER
I20260808 14:59:24.297444 2596 consensus_queue.cc:237] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } }
I20260808 14:59:24.304780 2451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } }
I20260808 14:59:24.305207 2451 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:24.305338 2451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f30af5dd10f46759e7f3d2dabff7beb, State: Initialized, Role: FOLLOWER
I20260808 14:59:24.306085 2451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } }
I20260808 14:59:24.312863 2637 sys_catalog.cc:455] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a13241decb2c489dbf2ff5b7e57fa3f3. Latest consensus state: current_term: 1 leader_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } } }
I20260808 14:59:24.313423 2637 sys_catalog.cc:458] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:24.313215 2642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } } }
I20260808 14:59:24.313587 2642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:59:24.315398 2451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:59:24.315430 2411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" is_pre_election: true
I20260808 14:59:24.316021 2411 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a13241decb2c489dbf2ff5b7e57fa3f3 in term 0.
I20260808 14:59:24.316879 2408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f30af5dd10f46759e7f3d2dabff7beb"
I20260808 14:59:24.317140 2408 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:24.320753 2408 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a13241decb2c489dbf2ff5b7e57fa3f3 in term 1.
I20260808 14:59:24.333778 2644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:59:24.336148 2644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:59:24.354413 2291 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [term 1 FOLLOWER]: Refusing update from remote peer a13241decb2c489dbf2ff5b7e57fa3f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:59:24.355543 2596 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:59:24.357206 2408 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [term 1 FOLLOWER]: Refusing update from remote peer a13241decb2c489dbf2ff5b7e57fa3f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:59:24.358441 2596 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:59:24.386807 2642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [sys.catalog]: SysCatalogTable state changed. Reason: New leader a13241decb2c489dbf2ff5b7e57fa3f3. Latest consensus state: current_term: 1 leader_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } } }
I20260808 14:59:24.387156 2642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:59:24.387872 2620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a13241decb2c489dbf2ff5b7e57fa3f3. Latest consensus state: current_term: 1 leader_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } } }
I20260808 14:59:24.388201 2620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:59:24.402218 2642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } } }
I20260808 14:59:24.402508 2642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:59:24.402825 2657 mvcc.cc:205] Tried to move back new op lower bound from 7316279969182720000 to 7316279968971472896. Current Snapshot: MvccSnapshot[applied={T|T < 7316279969182720000}]
I20260808 14:59:24.415871 2637 sys_catalog.cc:455] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } } }
I20260808 14:59:24.416155 2637 sys_catalog.cc:458] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:24.416597 2637 sys_catalog.cc:455] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } } }
I20260808 14:59:24.416806 2637 sys_catalog.cc:458] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:24.419700 2620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b16887ecc84f2782f3c80ed657a94e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33809 } } peers { permanent_uuid: "1f30af5dd10f46759e7f3d2dabff7beb" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 37707 } } peers { permanent_uuid: "a13241decb2c489dbf2ff5b7e57fa3f3" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 44951 } } }
I20260808 14:59:24.419965 2620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:59:24.419996 2644 catalog_manager.cc:1347] Generated new cluster ID: fe70d3980b564960b8992e0563e56018
I20260808 14:59:24.420086 2644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:59:24.439961 2666 catalog_manager.cc:1259] Loaded cluster ID: fe70d3980b564960b8992e0563e56018
I20260808 14:59:24.440083 2666 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb: loading cluster ID for follower catalog manager: success
W20260808 14:59:24.441278 2666 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260808 14:59:24.441421 2666 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:59:24.477008 2644 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:59:24.479084 2644 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:59:24.517633 2644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a13241decb2c489dbf2ff5b7e57fa3f3: Generated new TSK 0
I20260808 14:59:24.522837 2644 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:59:25.222357 2634 catalog_manager.cc:1259] Loaded cluster ID: fe70d3980b564960b8992e0563e56018
I20260808 14:59:25.222465 2634 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e: loading cluster ID for follower catalog manager: success
I20260808 14:59:25.224917 2634 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e: acquiring CA information for follower catalog manager: success
I20260808 14:59:25.226817 2634 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 85b16887ecc84f2782f3c80ed657a94e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:59:25.444645 2666 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb: acquiring CA information for follower catalog manager: success
I20260808 14:59:25.446717 2666 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1f30af5dd10f46759e7f3d2dabff7beb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:59:25.687788 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 2223
I20260808 14:59:25.689291 2321 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:25.800762 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 2223
I20260808 14:59:25.831223 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 2344
I20260808 14:59:25.832337 2445 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:25.943173 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 2344
I20260808 14:59:25.971495 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 2461
I20260808 14:59:25.972668 2568 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:26.083037 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 2461
2026-08-08T14:59:26Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5144 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:59:26 dist-test-slave-z8x9 krb5kdc[2687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:59:26 dist-test-slave-z8x9 krb5kdc[2687](info): set up 2 sockets
Aug 08 14:59:26 dist-test-slave-z8x9 krb5kdc[2687](info): commencing operation
krb5kdc: starting...
W20260808 14:59:27.432247 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.300s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:59:27 dist-test-slave-z8x9 krb5kdc[2687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:59:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:59:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:59:27.712160 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:40501
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:40501
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:28.051797 2711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:28.052135 2711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:28.052309 2711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:28.059607 2711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:59:28.059736 2711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:28.059825 2711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:28.059932 2711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:59:28.060009 2711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:59:28.069886 2711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:40501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:40501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:28.071233 2711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:28.072593 2711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:28.084362 2720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:28.084283 2721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:28.084331 2724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:28.085261 2711 server_base.cc:1034] running on GCE node
I20260808 14:59:28.085988 2711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:28.087244 2711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:28.088461 2711 hybrid_clock.cc:648] HybridClock initialized: now 1786201168088415 us; error 35 us; skew 500 ppm
I20260808 14:59:28.088825 2711 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:28 dist-test-slave-z8x9 krb5kdc[2687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201168, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:28.094930 2711 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:59:28.096392 2711 webserver.cc:460] Webserver started at http://127.12.73.190:45199/ using document root <none> and password file <none>
I20260808 14:59:28.097033 2711 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:28.097196 2711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:28.097549 2711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:59:28.100531 2711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "f5b7aab453b84a0986b07cdde72cb93c"
format_stamp: "Formatted at 2026-08-08 14:59:28 on dist-test-slave-z8x9"
server_key: "981a21b729686243e66f3da43d9e3229"
server_key_iv: "3314e44137f48f2b83c8d755039f802e"
server_key_version: "encryptionkey@0"
I20260808 14:59:28.101399 2711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "f5b7aab453b84a0986b07cdde72cb93c"
format_stamp: "Formatted at 2026-08-08 14:59:28 on dist-test-slave-z8x9"
server_key: "981a21b729686243e66f3da43d9e3229"
server_key_iv: "3314e44137f48f2b83c8d755039f802e"
server_key_version: "encryptionkey@0"
I20260808 14:59:28.106534 2711 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:59:28.110085 2735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:28.111342 2711 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:59:28.111524 2711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "f5b7aab453b84a0986b07cdde72cb93c"
format_stamp: "Formatted at 2026-08-08 14:59:28 on dist-test-slave-z8x9"
server_key: "981a21b729686243e66f3da43d9e3229"
server_key_iv: "3314e44137f48f2b83c8d755039f802e"
server_key_version: "encryptionkey@0"
I20260808 14:59:28.111719 2711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:28.138752 2711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:28.142704 2711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:28.142997 2711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:28.161454 2711 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:40501
I20260808 14:59:28.161478 2824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:40501 every 8 connection(s)
I20260808 14:59:28.162856 2711 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:59:28.166488 2827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:28.168574 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 2711
I20260808 14:59:28.168816 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:59:28.169692 12582 external_mini_cluster.cc:1428] Setting key b2300b9d03424869cc45178e17b41803
I20260808 14:59:28.179313 2827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c: Bootstrap starting.
I20260808 14:59:28.183176 2827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:28.184510 2827 log.cc:824] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:59:28 dist-test-slave-z8x9 krb5kdc[2687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:28.187455 2827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c: No bootstrap required, opened a new log
I20260808 14:59:28.194020 2833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:28.171568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56696 (local address 127.12.73.190:40501)
0808 14:59:28.172420 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:28.172434 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:28.172478 (+ 44us) server_negotiation.cc:407] Connection header received
0808 14:59:28.174235 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:28.174258 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:28.174623 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:28.174925 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:28.176844 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:28.178259 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:28.180098 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:28.180769 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:28.180920 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:28.186387 (+ 5467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:28.186395 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:28.186409 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:28.186445 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:28.189728 (+ 3283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:28.190529 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:28.190543 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:28.190549 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:28.190729 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:28.191140 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:28.191145 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:28.191148 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:28.191676 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:28.192022 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:28.192483 (+ 461us) server_negotiation.cc:299] Negotiation successful
0808 14:59:28.192927 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":406,"threads_started":1}
I20260808 14:59:28.195627 2827 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5b7aab453b84a0986b07cdde72cb93c" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 40501 } }
I20260808 14:59:28.196007 2827 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:28.196120 2827 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5b7aab453b84a0986b07cdde72cb93c, State: Initialized, Role: FOLLOWER
I20260808 14:59:28.196748 2827 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5b7aab453b84a0986b07cdde72cb93c" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 40501 } }
I20260808 14:59:28.197017 2827 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:59:28.197208 2827 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:59:28.197422 2827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:28.198153 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:59:28.200366 2827 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5b7aab453b84a0986b07cdde72cb93c" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 40501 } }
I20260808 14:59:28.200881 2827 leader_election.cc:302] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5b7aab453b84a0986b07cdde72cb93c; no voters:
I20260808 14:59:28.201601 2827 leader_election.cc:288] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:59:28.201756 2837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:59:28.202416 2837 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [term 1 LEADER]: Becoming Leader. State: Replica: f5b7aab453b84a0986b07cdde72cb93c, State: Running, Role: LEADER
I20260808 14:59:28.202978 2837 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5b7aab453b84a0986b07cdde72cb93c" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 40501 } }
I20260808 14:59:28.203821 2827 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:59:28.206017 2843 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5b7aab453b84a0986b07cdde72cb93c. Latest consensus state: current_term: 1 leader_uuid: "f5b7aab453b84a0986b07cdde72cb93c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5b7aab453b84a0986b07cdde72cb93c" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 40501 } } }
I20260808 14:59:28.206097 2840 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5b7aab453b84a0986b07cdde72cb93c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5b7aab453b84a0986b07cdde72cb93c" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 40501 } } }
I20260808 14:59:28.206461 2843 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:28.206548 2840 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:28.208249 2846 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:59:28.214687 2846 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:59:28.224105 2846 catalog_manager.cc:1347] Generated new cluster ID: a4f0ecf4f06c44cfbede6a7bde515feb
I20260808 14:59:28.224237 2846 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:59:28.230984 2846 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:59:28.232821 2846 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:59:28.245043 2846 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5b7aab453b84a0986b07cdde72cb93c: Generated new TSK 0
I20260808 14:59:28.246223 2846 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:59:28.259508 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 2711
I20260808 14:59:28.260689 2820 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:28.350056 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 2711
2026-08-08T14:59:28Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2262 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:59:28 dist-test-slave-z8x9 krb5kdc[2876](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:59:28 dist-test-slave-z8x9 krb5kdc[2876](info): set up 2 sockets
Aug 08 14:59:28 dist-test-slave-z8x9 krb5kdc[2876](info): commencing operation
krb5kdc: starting...
W20260808 14:59:29.706427 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.002s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:59:29 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:59:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:59:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:59:29.989419 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36059
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:36059
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:30.336606 2891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:30.336941 2891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:30.337085 2891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:30.344379 2891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:59:30.344489 2891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:30.344540 2891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:30.344597 2891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:59:30.344638 2891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:59:30.354940 2891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:36059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:30.356177 2891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:30.357575 2891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:30.369396 2898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:30.369517 2899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:30.369361 2907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:30.370481 2891 server_base.cc:1034] running on GCE node
I20260808 14:59:30.371215 2891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:30.372526 2891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:30.373744 2891 hybrid_clock.cc:648] HybridClock initialized: now 1786201170373699 us; error 33 us; skew 500 ppm
I20260808 14:59:30.374063 2891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:30 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201170, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:30.377228 2891 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:59:30.378732 2891 webserver.cc:460] Webserver started at http://127.12.73.190:44057/ using document root <none> and password file <none>
I20260808 14:59:30.379398 2891 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:30.379563 2891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:30.379868 2891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:59:30.382834 2891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe"
format_stamp: "Formatted at 2026-08-08 14:59:30 on dist-test-slave-z8x9"
server_key: "f732f10097b01c390323f47cfe4bc82f"
server_key_iv: "9478faaf92865d8fd01a1b35b6d8cea6"
server_key_version: "encryptionkey@0"
I20260808 14:59:30.383649 2891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe"
format_stamp: "Formatted at 2026-08-08 14:59:30 on dist-test-slave-z8x9"
server_key: "f732f10097b01c390323f47cfe4bc82f"
server_key_iv: "9478faaf92865d8fd01a1b35b6d8cea6"
server_key_version: "encryptionkey@0"
I20260808 14:59:30.388710 2891 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:59:30.392225 2914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:30.393575 2891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 14:59:30.393771 2891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe"
format_stamp: "Formatted at 2026-08-08 14:59:30 on dist-test-slave-z8x9"
server_key: "f732f10097b01c390323f47cfe4bc82f"
server_key_iv: "9478faaf92865d8fd01a1b35b6d8cea6"
server_key_version: "encryptionkey@0"
I20260808 14:59:30.393968 2891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:30.418946 2891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:30.423400 2891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:30.423719 2891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:30.442971 2891 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:36059
I20260808 14:59:30.443017 2999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:36059 every 8 connection(s)
I20260808 14:59:30.444332 2891 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:59:30.448004 3000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:30.449214 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 2891
I20260808 14:59:30.449460 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:59:30.450110 12582 external_mini_cluster.cc:1428] Setting key dd18db2abd9a36132909de56d461e205
I20260808 14:59:30.461748 3000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Bootstrap starting.
Aug 08 14:59:30 dist-test-slave-z8x9 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:30.465737 3000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:30.466785 3000 log.cc:824] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:30.469720 3000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: No bootstrap required, opened a new log
I20260808 14:59:30.474186 3003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:30.452217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52332 (local address 127.12.73.190:36059)
0808 14:59:30.453110 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:30.453122 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:30.453161 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:59:30.454739 (+ 1578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:30.454764 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:30.455129 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:30.455446 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:30.457330 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:30.458677 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:30.460610 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:30.461318 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:30.461449 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:30.466569 (+ 5120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:30.466576 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:30.466591 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:30.466651 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:30.469988 (+ 3337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:30.470727 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:30.470734 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:30.470739 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:30.470923 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:30.471335 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:30.471344 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:30.471346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:30.471886 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:30.472241 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:30.472682 (+ 441us) server_negotiation.cc:299] Negotiation successful
0808 14:59:30.473128 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":403,"threads_started":1}
I20260808 14:59:30.477739 3000 raft_consensus.cc:348] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } }
I20260808 14:59:30.478096 3000 raft_consensus.cc:374] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:30.478219 3000 raft_consensus.cc:729] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d918ec859d1a4220a51b7e6fa2c3cdfe, State: Initialized, Role: FOLLOWER
I20260808 14:59:30.478813 3000 consensus_queue.cc:260] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } }
I20260808 14:59:30.479046 3000 raft_consensus.cc:388] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:59:30.479210 3000 raft_consensus.cc:482] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:59:30.479399 3000 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:30.481873 3000 raft_consensus.cc:504] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } }
I20260808 14:59:30.482292 3000 leader_election.cc:302] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d918ec859d1a4220a51b7e6fa2c3cdfe; no voters:
I20260808 14:59:30.482829 3000 leader_election.cc:288] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:59:30.482973 3006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:59:30.483664 3006 raft_consensus.cc:686] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 1 LEADER]: Becoming Leader. State: Replica: d918ec859d1a4220a51b7e6fa2c3cdfe, State: Running, Role: LEADER
I20260808 14:59:30.484246 3006 consensus_queue.cc:237] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } }
I20260808 14:59:30.484892 3000 sys_catalog.cc:564] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:59:30.486963 3007 sys_catalog.cc:455] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } } }
I20260808 14:59:30.487339 3007 sys_catalog.cc:458] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:30.490768 3008 sys_catalog.cc:455] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: SysCatalogTable state changed. Reason: New leader d918ec859d1a4220a51b7e6fa2c3cdfe. Latest consensus state: current_term: 1 leader_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } } }
I20260808 14:59:30.491233 3008 sys_catalog.cc:458] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:30.492215 3014 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:59:30.496541 3014 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:59:30.504555 3014 catalog_manager.cc:1347] Generated new cluster ID: fd86f255d0854f038aa87d49a0ae15c0
I20260808 14:59:30.504658 3014 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:59:30.514669 3014 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:59:30.515901 3014 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:59:30.524679 3014 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Generated new TSK 0
I20260808 14:59:30.525549 3014 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:59:30.593382 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36059
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:30.936141 3034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:30.936416 3034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:30.936517 3034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:30.943835 3034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:30.943940 3034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:30.944051 3034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:59:30.953637 3034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36059
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:30.954875 3034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:30.956118 3034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:30.969200 3041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:30.969242 3044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:30.969281 3046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:30.970369 3034 server_base.cc:1034] running on GCE node
I20260808 14:59:30.970970 3034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:30.971854 3034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:30.973090 3034 hybrid_clock.cc:648] HybridClock initialized: now 1786201170973054 us; error 48 us; skew 500 ppm
I20260808 14:59:30.973438 3034 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:30 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201170, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:30.976972 3034 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:59:30.978536 3034 webserver.cc:460] Webserver started at http://127.12.73.129:38221/ using document root <none> and password file <none>
I20260808 14:59:30.979214 3034 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:30.979368 3034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:30.979699 3034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:59:30.982698 3034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "c98d66bf6f43403ca4fead3d4ab01576"
format_stamp: "Formatted at 2026-08-08 14:59:30 on dist-test-slave-z8x9"
server_key: "dd0d1af567b1cde85197253c7c514f4a"
server_key_iv: "1530635e28d2fb6dd73eb4256ede3727"
server_key_version: "encryptionkey@0"
I20260808 14:59:30.983511 3034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "c98d66bf6f43403ca4fead3d4ab01576"
format_stamp: "Formatted at 2026-08-08 14:59:30 on dist-test-slave-z8x9"
server_key: "dd0d1af567b1cde85197253c7c514f4a"
server_key_iv: "1530635e28d2fb6dd73eb4256ede3727"
server_key_version: "encryptionkey@0"
I20260808 14:59:30.988464 3034 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 14:59:30.991886 3060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:30.993391 3034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:59:30.993568 3034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "c98d66bf6f43403ca4fead3d4ab01576"
format_stamp: "Formatted at 2026-08-08 14:59:30 on dist-test-slave-z8x9"
server_key: "dd0d1af567b1cde85197253c7c514f4a"
server_key_iv: "1530635e28d2fb6dd73eb4256ede3727"
server_key_version: "encryptionkey@0"
I20260808 14:59:30.993752 3034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:31.027165 3034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:31.031111 3034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:31.031401 3034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:31.032361 3034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:31.033706 3034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:31.033779 3034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:31.033959 3034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:31.034030 3034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:31.067165 3034 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:38443
I20260808 14:59:31.067205 3238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:38443 every 8 connection(s)
I20260808 14:59:31.068472 3034 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:59:31.071625 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 3034
I20260808 14:59:31.071864 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:59:31.072860 12582 external_mini_cluster.cc:1428] Setting key f72730df4d9be7c27bbd0f16567b6560
Aug 08 14:59:31 dist-test-slave-z8x9 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201170, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:31.090250 3243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:31.071071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:60765 (local address 127.12.73.190:36059)
0808 14:59:31.072151 (+ 1080us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:31.072156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:31.072869 (+ 713us) server_negotiation.cc:407] Connection header received
0808 14:59:31.074993 (+ 2124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:31.075000 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:31.075107 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:31.075230 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:31.076683 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:31.077467 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:31.078999 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:31.079397 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:31.079545 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:31.083305 (+ 3760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:31.083315 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:31.083322 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:31.083377 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:31.086820 (+ 3443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:31.087788 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:31.087793 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:31.087795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:31.087959 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:31.088474 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:31.088478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:31.088480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:31.088730 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:31.088906 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:31.089798 (+ 892us) server_negotiation.cc:299] Negotiation successful
0808 14:59:31.089969 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":961,"thread_start_us":861,"threads_started":1}
I20260808 14:59:31.091945 3244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:31.071632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:60765)
0808 14:59:31.072680 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:31.072717 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:31.074737 (+ 2020us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:31.075472 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:31.075480 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:31.075975 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:31.076513 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:31.076531 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:31.077628 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:31.077632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:31.078842 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:31.078854 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:31.079630 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:31.079639 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:31.079878 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:31.080601 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:31.080627 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:31.083079 (+ 2452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:31.086964 (+ 3885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:31.086976 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:31.086993 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:31.087671 (+ 678us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:31.088080 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:31.088089 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:31.088095 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:31.088351 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:31.088910 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:31.088921 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:31.089397 (+ 476us) client_negotiation.cc:769] Sending connection context
0808 14:59:31.089735 (+ 338us) client_negotiation.cc:240] Negotiation successful
0808 14:59:31.090341 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"thread_start_us":636,"threads_started":1}
I20260808 14:59:31.093540 3240 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36059
I20260808 14:59:31.093856 3240 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:31.094587 3240 heartbeater.cc:511] Master 127.12.73.190:36059 requested a full tablet report, sending...
I20260808 14:59:31.096669 2945 ts_manager.cc:194] Registered new tserver with Master: c98d66bf6f43403ca4fead3d4ab01576 (127.12.73.129:38443)
I20260808 14:59:31.098841 2945 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:60765
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:59:31.140187 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36059
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:31.469982 3247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:31.470276 3247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:31.470443 3247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:31.477685 3247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:31.477821 3247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:31.477993 3247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:59:31.487396 3247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36059
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:31.488649 3247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:31.490406 3247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:31.503949 3257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:31.503974 3263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:31.503912 3260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:31.504765 3247 server_base.cc:1034] running on GCE node
I20260808 14:59:31.505447 3247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:31.506315 3247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:31.507520 3247 hybrid_clock.cc:648] HybridClock initialized: now 1786201171507456 us; error 57 us; skew 500 ppm
I20260808 14:59:31.507795 3247 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:31 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:31.511013 3247 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:59:31.512374 3247 webserver.cc:460] Webserver started at http://127.12.73.130:43815/ using document root <none> and password file <none>
I20260808 14:59:31.512979 3247 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:31.513078 3247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:31.513412 3247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:59:31.516247 3247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "c25aa19d27a5475389cbb463c20b6fb4"
format_stamp: "Formatted at 2026-08-08 14:59:31 on dist-test-slave-z8x9"
server_key: "21204a4574f233351d4cc0477b5e80b4"
server_key_iv: "2782de51edd44ff4701327900c0b7d08"
server_key_version: "encryptionkey@0"
I20260808 14:59:31.516964 3247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "c25aa19d27a5475389cbb463c20b6fb4"
format_stamp: "Formatted at 2026-08-08 14:59:31 on dist-test-slave-z8x9"
server_key: "21204a4574f233351d4cc0477b5e80b4"
server_key_iv: "2782de51edd44ff4701327900c0b7d08"
server_key_version: "encryptionkey@0"
I20260808 14:59:31.521799 3247 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 14:59:31.525028 3280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:31.526443 3247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:59:31.526566 3247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "c25aa19d27a5475389cbb463c20b6fb4"
format_stamp: "Formatted at 2026-08-08 14:59:31 on dist-test-slave-z8x9"
server_key: "21204a4574f233351d4cc0477b5e80b4"
server_key_iv: "2782de51edd44ff4701327900c0b7d08"
server_key_version: "encryptionkey@0"
I20260808 14:59:31.526726 3247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:31.540774 3247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:31.545293 3247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:31.545547 3247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:31.546491 3247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:31.547780 3247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:31.547870 3247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:31.547961 3247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:31.548009 3247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:31.581513 3247 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:39807
I20260808 14:59:31.581575 3452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:39807 every 8 connection(s)
I20260808 14:59:31.582882 3247 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:59:31.587369 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 3247
I20260808 14:59:31.587574 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:59:31.588136 12582 external_mini_cluster.cc:1428] Setting key 0b0a606f5ed8191f3766ea6d5174aa9e
Aug 08 14:59:31 dist-test-slave-z8x9 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:31.604579 3243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:31.585682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:43639 (local address 127.12.73.190:36059)
0808 14:59:31.585895 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:31.585923 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:31.587104 (+ 1181us) server_negotiation.cc:407] Connection header received
0808 14:59:31.589274 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:31.589278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:31.589342 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:31.589428 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:31.591129 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:31.591820 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:31.593432 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:31.593873 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:31.594005 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:31.598517 (+ 4512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:31.598522 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:31.598525 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:31.598557 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:31.601152 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:31.602133 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:31.602137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:31.602139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:31.602271 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:31.602844 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:31.602849 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:31.602851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:31.603141 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:31.603267 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:31.604150 (+ 883us) server_negotiation.cc:299] Negotiation successful
0808 14:59:31.604330 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:59:31.606073 3455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:31.586257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:43639)
0808 14:59:31.586950 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:31.586992 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:31.588977 (+ 1985us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:31.589678 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:31.589689 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:31.590427 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:31.590961 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:31.590979 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:31.591996 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:31.592001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:31.593287 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:31.593300 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:31.594114 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:31.594121 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:31.594352 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:31.595162 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:31.595194 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:31.598297 (+ 3103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:31.601344 (+ 3047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:31.601355 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:31.601374 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:31.602016 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:31.602439 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:31.602446 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:31.602453 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:31.602708 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:31.603279 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:31.603289 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:31.603742 (+ 453us) client_negotiation.cc:769] Sending connection context
0808 14:59:31.604055 (+ 313us) client_negotiation.cc:240] Negotiation successful
0808 14:59:31.604618 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":273,"threads_started":1}
I20260808 14:59:31.607652 3453 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36059
I20260808 14:59:31.607993 3453 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:31.608867 3453 heartbeater.cc:511] Master 127.12.73.190:36059 requested a full tablet report, sending...
I20260808 14:59:31.610486 2945 ts_manager.cc:194] Registered new tserver with Master: c25aa19d27a5475389cbb463c20b6fb4 (127.12.73.130:39807)
I20260808 14:59:31.611761 2945 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:43639
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:59:31.654448 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36059
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:32.005192 3460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:32.005465 3460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:32.005569 3460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:32.012606 3460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:32.012718 3460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:32.012832 3460 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:59:32.022500 3460 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36059
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:32.023734 3460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:32.024977 3460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:32.038347 3475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:32.038465 3472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:32.038443 3480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:32.039575 3460 server_base.cc:1034] running on GCE node
I20260808 14:59:32.040122 3460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:32.040989 3460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:32.042192 3460 hybrid_clock.cc:648] HybridClock initialized: now 1786201172042158 us; error 66 us; skew 500 ppm
I20260808 14:59:32.042526 3460 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:32 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201172, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:32.050419 3460 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:59:32.051975 3460 webserver.cc:460] Webserver started at http://127.12.73.131:32879/ using document root <none> and password file <none>
I20260808 14:59:32.052678 3460 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:32.052829 3460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:32.053149 3460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:59:32.056113 3460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "158e36f4831741dbb359144f59e937e6"
format_stamp: "Formatted at 2026-08-08 14:59:32 on dist-test-slave-z8x9"
server_key: "2a31400f1f6a82fb1ae9e5e8e4fcd297"
server_key_iv: "6409c08c621f8febfafd3b370de89956"
server_key_version: "encryptionkey@0"
I20260808 14:59:32.056895 3460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "158e36f4831741dbb359144f59e937e6"
format_stamp: "Formatted at 2026-08-08 14:59:32 on dist-test-slave-z8x9"
server_key: "2a31400f1f6a82fb1ae9e5e8e4fcd297"
server_key_iv: "6409c08c621f8febfafd3b370de89956"
server_key_version: "encryptionkey@0"
I20260808 14:59:32.062068 3460 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 14:59:32.065466 3490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:32.067123 3460 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:59:32.067299 3460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "158e36f4831741dbb359144f59e937e6"
format_stamp: "Formatted at 2026-08-08 14:59:32 on dist-test-slave-z8x9"
server_key: "2a31400f1f6a82fb1ae9e5e8e4fcd297"
server_key_iv: "6409c08c621f8febfafd3b370de89956"
server_key_version: "encryptionkey@0"
I20260808 14:59:32.067556 3460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:32.090678 3460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:32.094532 3460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:32.094789 3460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:32.095654 3460 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:32.097002 3460 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:32.097077 3460 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:32.097241 3460 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:32.097295 3460 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 14:59:32.101752 3240 heartbeater.cc:503] Master 127.12.73.190:36059 was elected leader, sending a full tablet report...
I20260808 14:59:32.132943 3460 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:34431
I20260808 14:59:32.132989 3671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:34431 every 8 connection(s)
I20260808 14:59:32.134323 3460 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:59:32.137442 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 3460
I20260808 14:59:32.137650 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:59:32.138276 12582 external_mini_cluster.cc:1428] Setting key 001b6a253540a8d130c3cfc2ced6f8bd
Aug 08 14:59:32 dist-test-slave-z8x9 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201172, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:32.154558 3676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.136939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:40023 (local address 127.12.73.190:36059)
0808 14:59:32.137500 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:32.137507 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:32.138631 (+ 1124us) server_negotiation.cc:407] Connection header received
0808 14:59:32.140663 (+ 2032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:32.140670 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:32.140754 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:32.140870 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:32.142629 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.143376 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.144895 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.145407 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.145510 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.148733 (+ 3223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:32.148737 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:32.148740 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:32.148771 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:32.151354 (+ 2583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:32.152227 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:32.152231 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:32.152233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:32.152389 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:32.152931 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:32.152937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:32.152940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:32.153321 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:32.153473 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:32.154117 (+ 644us) server_negotiation.cc:299] Negotiation successful
0808 14:59:32.154276 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":279,"threads_started":1}
I20260808 14:59:32.155539 3677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.137534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:40023)
0808 14:59:32.138440 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:32.138491 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:32.140403 (+ 1912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:32.141057 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:32.141064 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:32.141818 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:32.142467 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:32.142486 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.143510 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.143513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:32.144666 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:32.144678 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.145599 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.145604 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:32.145810 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.146417 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:32.146444 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:32.148544 (+ 2100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:32.151477 (+ 2933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:32.151483 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:32.151493 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:32.152077 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:32.152502 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:32.152507 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:32.152511 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:32.152781 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:32.153449 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:32.153454 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:32.153772 (+ 318us) client_negotiation.cc:769] Sending connection context
0808 14:59:32.154029 (+ 257us) client_negotiation.cc:240] Negotiation successful
0808 14:59:32.154426 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":336,"threads_started":1}
I20260808 14:59:32.156783 3674 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36059
I20260808 14:59:32.157064 3674 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:32.157779 3674 heartbeater.cc:511] Master 127.12.73.190:36059 requested a full tablet report, sending...
I20260808 14:59:32.159085 2945 ts_manager.cc:194] Registered new tserver with Master: 158e36f4831741dbb359144f59e937e6 (127.12.73.131:34431)
I20260808 14:59:32.159929 2945 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:40023
I20260808 14:59:32.165938 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:59:32.182904 3676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.170467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52336 (local address 127.12.73.190:36059)
0808 14:59:32.170616 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:32.170620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:32.171049 (+ 429us) server_negotiation.cc:407] Connection header received
0808 14:59:32.171180 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:32.171184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:32.171243 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:32.171323 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:32.172803 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.173658 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.175048 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.175457 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.175557 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.177845 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:32.177849 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:32.177852 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:32.177881 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:32.180606 (+ 2725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:32.181273 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:32.181277 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:32.181280 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:32.181416 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:32.181739 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:32.181742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:32.181744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:32.182044 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:32.182229 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:32.182486 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 14:59:32.182666 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:59:32.186959 2945 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:59:32.194003 2945 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:59:32.230962 3696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.210459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53144 (local address 127.12.73.130:39807)
0808 14:59:32.211736 (+ 1277us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:32.211748 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:32.211925 (+ 177us) server_negotiation.cc:407] Connection header received
0808 14:59:32.212303 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:32.212315 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:32.212619 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:32.212854 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:32.215613 (+ 2759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.219297 (+ 3684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.224817 (+ 5520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.228604 (+ 3787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.228789 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.229062 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:32.230289 (+ 1227us) server_negotiation.cc:299] Negotiation successful
0808 14:59:32.230576 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1060,"thread_start_us":1283,"threads_started":1}
I20260808 14:59:32.232273 3695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.208816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:39807 (local address 127.0.0.1:53144)
0808 14:59:32.211749 (+ 2933us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:32.211794 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:32.211998 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:32.214494 (+ 2496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:32.214506 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:32.214548 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:32.215110 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:32.215137 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.219533 (+ 4396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.219542 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:32.224536 (+ 4994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:32.224559 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.229242 (+ 4683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.229250 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:32.229519 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.229590 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 14:59:32.229737 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 14:59:32.229998 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2674,"thread_start_us":21883,"threads_started":1}
I20260808 14:59:32.237816 3698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.208830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38443 (local address 127.0.0.1:51634)
0808 14:59:32.222467 (+ 13637us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:32.222495 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:32.222649 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:32.229578 (+ 6929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:32.229616 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:32.229647 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:32.230290 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:32.230332 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.232577 (+ 2245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.232584 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:32.234818 (+ 2234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:32.234832 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.236874 (+ 2042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.236880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:32.237088 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.237138 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 14:59:32.237279 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 14:59:32.237431 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13423,"thread_start_us":3093,"threads_started":1}
I20260808 14:59:32.238819 3697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.211576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51634 (local address 127.12.73.129:38443)
0808 14:59:32.228745 (+ 17169us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:32.228757 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:32.228792 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:59:32.228929 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:32.228938 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:32.229339 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:32.229591 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:32.230822 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.232365 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.235038 (+ 2673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.236620 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.236761 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.237006 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:32.238318 (+ 1312us) server_negotiation.cc:299] Negotiation successful
0808 14:59:32.238490 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16965,"thread_start_us":18227,"threads_started":1}
I20260808 14:59:32.239861 3356 tablet_service.cc:1467] Processing CreateTablet for tablet aa05486027ea429ca8fbcc6124680dc8 (DEFAULT_TABLE table=test-table [id=6473d5a1b6c44922b06368df5e2a476d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:59:32.241497 3356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa05486027ea429ca8fbcc6124680dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:32.241549 3694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.212627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:34431 (local address 127.0.0.1:52498)
0808 14:59:32.230743 (+ 18116us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:32.230765 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:32.230904 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:32.233705 (+ 2801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:32.233710 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:32.233743 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:32.234162 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:32.234174 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.236339 (+ 2165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.236344 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:32.238686 (+ 2342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:32.238704 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.240804 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.240810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:32.240981 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.241027 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:59:32.241101 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:59:32.241252 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17971,"thread_start_us":9473,"threads_started":1}
I20260808 14:59:32.242344 3700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.213011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52498 (local address 127.12.73.131:34431)
0808 14:59:32.226791 (+ 13780us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:32.226809 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:32.231055 (+ 4246us) server_negotiation.cc:407] Connection header received
0808 14:59:32.231347 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:32.231356 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:32.231646 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:32.231826 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:32.234484 (+ 2658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.236161 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.238861 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.240279 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.240430 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.240664 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:32.241873 (+ 1209us) server_negotiation.cc:299] Negotiation successful
0808 14:59:32.242064 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13388,"thread_start_us":12969,"threads_started":1}
I20260808 14:59:32.242547 3149 tablet_service.cc:1467] Processing CreateTablet for tablet aa05486027ea429ca8fbcc6124680dc8 (DEFAULT_TABLE table=test-table [id=6473d5a1b6c44922b06368df5e2a476d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:59:32.243954 3149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa05486027ea429ca8fbcc6124680dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:32.244957 3571 tablet_service.cc:1467] Processing CreateTablet for tablet aa05486027ea429ca8fbcc6124680dc8 (DEFAULT_TABLE table=test-table [id=6473d5a1b6c44922b06368df5e2a476d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:59:32.246141 3571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa05486027ea429ca8fbcc6124680dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:32.257933 3701 tablet_bootstrap.cc:492] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4: Bootstrap starting.
I20260808 14:59:32.258966 3702 tablet_bootstrap.cc:492] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576: Bootstrap starting.
I20260808 14:59:32.261148 3701 tablet_bootstrap.cc:654] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:32.262672 3701 log.cc:824] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:32.263041 3703 tablet_bootstrap.cc:492] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6: Bootstrap starting.
I20260808 14:59:32.263351 3702 tablet_bootstrap.cc:654] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:32.264636 3702 log.cc:824] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:32.267704 3703 tablet_bootstrap.cc:654] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:32.269142 3701 tablet_bootstrap.cc:492] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4: No bootstrap required, opened a new log
I20260808 14:59:32.269141 3703 log.cc:824] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:32.269524 3701 ts_tablet_manager.cc:1397] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.008s
I20260808 14:59:32.269587 3702 tablet_bootstrap.cc:492] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576: No bootstrap required, opened a new log
I20260808 14:59:32.269831 3702 ts_tablet_manager.cc:1397] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260808 14:59:32.272293 3703 tablet_bootstrap.cc:492] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6: No bootstrap required, opened a new log
I20260808 14:59:32.272662 3703 ts_tablet_manager.cc:1397] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20260808 14:59:32.280359 3701 raft_consensus.cc:348] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } } peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } }
I20260808 14:59:32.280879 3701 raft_consensus.cc:374] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:32.281008 3701 raft_consensus.cc:729] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25aa19d27a5475389cbb463c20b6fb4, State: Initialized, Role: FOLLOWER
I20260808 14:59:32.281777 3701 consensus_queue.cc:260] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } } peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } }
I20260808 14:59:32.282114 3702 raft_consensus.cc:348] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } } peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } }
I20260808 14:59:32.282598 3702 raft_consensus.cc:374] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:32.282734 3702 raft_consensus.cc:729] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98d66bf6f43403ca4fead3d4ab01576, State: Initialized, Role: FOLLOWER
I20260808 14:59:32.282991 3453 heartbeater.cc:503] Master 127.12.73.190:36059 was elected leader, sending a full tablet report...
I20260808 14:59:32.283358 3702 consensus_queue.cc:260] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } } peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } }
I20260808 14:59:32.285059 3702 ts_tablet_manager.cc:1428] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576: Time spent starting tablet: real 0.015s user 0.009s sys 0.003s
I20260808 14:59:32.286813 3703 raft_consensus.cc:348] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } } peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } }
I20260808 14:59:32.287362 3703 raft_consensus.cc:374] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:32.287451 3701 ts_tablet_manager.cc:1428] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4: Time spent starting tablet: real 0.018s user 0.013s sys 0.000s
I20260808 14:59:32.287518 3703 raft_consensus.cc:729] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158e36f4831741dbb359144f59e937e6, State: Initialized, Role: FOLLOWER
I20260808 14:59:32.288242 3703 consensus_queue.cc:260] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } } peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } }
I20260808 14:59:32.289455 3674 heartbeater.cc:503] Master 127.12.73.190:36059 was elected leader, sending a full tablet report...
I20260808 14:59:32.290171 3703 ts_tablet_manager.cc:1428] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6: Time spent starting tablet: real 0.017s user 0.008s sys 0.007s
W20260808 14:59:32.320890 3242 tablet.cc:2369] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:59:32.334925 3454 tablet.cc:2369] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:59:32.348392 3709 raft_consensus.cc:482] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:59:32.348670 3709 raft_consensus.cc:504] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } } peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } }
I20260808 14:59:32.350426 3709 leader_election.cc:288] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 158e36f4831741dbb359144f59e937e6 (127.12.73.131:34431), c25aa19d27a5475389cbb463c20b6fb4 (127.12.73.130:39807)
I20260808 14:59:32.359695 3696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.350890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:44785 (local address 127.12.73.130:39807)
0808 14:59:32.351240 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:32.351246 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:32.351754 (+ 508us) server_negotiation.cc:407] Connection header received
0808 14:59:32.351955 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:32.351960 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:32.352030 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:32.352131 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:32.353046 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.354208 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.357301 (+ 3093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.358529 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.358700 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.358773 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:32.359300 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 14:59:32.359432 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180}
I20260808 14:59:32.359695 3700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.350964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:52593 (local address 127.12.73.131:34431)
0808 14:59:32.351196 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:32.351205 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:32.351702 (+ 497us) server_negotiation.cc:407] Connection header received
0808 14:59:32.351937 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:32.351942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:32.352024 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:32.352131 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:32.353035 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.354208 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.357276 (+ 3068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.358529 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.358704 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.358773 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:32.359300 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 14:59:32.359440 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:59:32.359926 3711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.350710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:34431 (local address 127.12.73.129:52593)
0808 14:59:32.351557 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:32.351583 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:32.351759 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:32.352216 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:32.352222 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:32.352277 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:32.352822 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:32.352841 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.354353 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.354356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:32.357084 (+ 2728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:32.357101 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.358809 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.358814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:32.359058 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.359150 (+ 92us) client_negotiation.cc:769] Sending connection context
0808 14:59:32.359251 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:59:32.359417 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"mutex_wait_us":234,"spinlock_wait_cycles":35072,"thread_start_us":418,"threads_started":1}
I20260808 14:59:32.360126 3713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.350790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:39807 (local address 127.12.73.129:44785)
0808 14:59:32.351633 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:32.351661 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:32.351821 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:32.352216 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:32.352224 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:32.352256 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:32.352873 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:32.352885 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.354344 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.354350 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:32.357087 (+ 2737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:32.357101 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.358797 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.358803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:32.359052 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.359154 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 14:59:32.359251 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 14:59:32.359417 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"mutex_wait_us":258,"spinlock_wait_cycles":23424,"thread_start_us":592,"threads_started":1}
I20260808 14:59:32.361372 3610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa05486027ea429ca8fbcc6124680dc8" candidate_uuid: "c98d66bf6f43403ca4fead3d4ab01576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158e36f4831741dbb359144f59e937e6" is_pre_election: true
I20260808 14:59:32.361352 3388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa05486027ea429ca8fbcc6124680dc8" candidate_uuid: "c98d66bf6f43403ca4fead3d4ab01576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25aa19d27a5475389cbb463c20b6fb4" is_pre_election: true
I20260808 14:59:32.361960 3610 raft_consensus.cc:2454] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98d66bf6f43403ca4fead3d4ab01576 in term 0.
I20260808 14:59:32.361971 3388 raft_consensus.cc:2454] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98d66bf6f43403ca4fead3d4ab01576 in term 0.
I20260808 14:59:32.362742 3065 leader_election.cc:302] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 158e36f4831741dbb359144f59e937e6, c25aa19d27a5475389cbb463c20b6fb4, c98d66bf6f43403ca4fead3d4ab01576; no voters:
I20260808 14:59:32.363214 3709 raft_consensus.cc:2781] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:59:32.363394 3709 raft_consensus.cc:482] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:59:32.363511 3709 raft_consensus.cc:3037] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:32.365847 3709 raft_consensus.cc:504] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } } peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } }
I20260808 14:59:32.366536 3709 leader_election.cc:288] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [CANDIDATE]: Term 1 election: Requested vote from peers 158e36f4831741dbb359144f59e937e6 (127.12.73.131:34431), c25aa19d27a5475389cbb463c20b6fb4 (127.12.73.130:39807)
I20260808 14:59:32.367101 3610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa05486027ea429ca8fbcc6124680dc8" candidate_uuid: "c98d66bf6f43403ca4fead3d4ab01576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158e36f4831741dbb359144f59e937e6"
I20260808 14:59:32.367092 3388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa05486027ea429ca8fbcc6124680dc8" candidate_uuid: "c98d66bf6f43403ca4fead3d4ab01576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25aa19d27a5475389cbb463c20b6fb4"
I20260808 14:59:32.367319 3388 raft_consensus.cc:3037] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:32.367334 3610 raft_consensus.cc:3037] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:32.370671 3610 raft_consensus.cc:2454] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98d66bf6f43403ca4fead3d4ab01576 in term 1.
I20260808 14:59:32.370671 3388 raft_consensus.cc:2454] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98d66bf6f43403ca4fead3d4ab01576 in term 1.
I20260808 14:59:32.371132 3062 leader_election.cc:302] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c25aa19d27a5475389cbb463c20b6fb4, c98d66bf6f43403ca4fead3d4ab01576; no voters:
I20260808 14:59:32.371438 3709 raft_consensus.cc:2781] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:59:32.371896 3709 raft_consensus.cc:686] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 1 LEADER]: Becoming Leader. State: Replica: c98d66bf6f43403ca4fead3d4ab01576, State: Running, Role: LEADER
I20260808 14:59:32.372468 3709 consensus_queue.cc:237] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } } peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } }
I20260808 14:59:32.376791 2945 catalog_manager.cc:5495] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98d66bf6f43403ca4fead3d4ab01576 (127.12.73.129). New cstate: current_term: 1 leader_uuid: "c98d66bf6f43403ca4fead3d4ab01576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } health_report { overall_health: UNKNOWN } } }
W20260808 14:59:32.385959 3675 tablet.cc:2369] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:59:32.416790 3697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.410872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44362 (local address 127.12.73.129:38443)
0808 14:59:32.411099 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:32.411120 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:32.411138 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:59:32.411238 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:32.411242 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:32.411324 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:32.411459 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:59:32.411845 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.412602 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.414625 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.415024 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.415126 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.415748 (+ 622us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:59:32.416293 (+ 545us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:59:32.416421 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:32.416512 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 14:59:32.416578 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:59:32.425009 3388 raft_consensus.cc:1261] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4 [term 1 FOLLOWER]: Refusing update from remote peer c98d66bf6f43403ca4fead3d4ab01576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:59:32.425006 3610 raft_consensus.cc:1261] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6 [term 1 FOLLOWER]: Refusing update from remote peer c98d66bf6f43403ca4fead3d4ab01576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:59:32.426060 3709 consensus_queue.cc:1035] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:59:32.426371 3714 consensus_queue.cc:1035] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:59:32.436863 3720 mvcc.cc:205] Tried to move back new op lower bound from 7316280002242985984 to 7316280002041548800. Current Snapshot: MvccSnapshot[applied={T|T < 7316280002242985984}]
I20260808 14:59:32.439606 3718 mvcc.cc:205] Tried to move back new op lower bound from 7316280002242985984 to 7316280002041548800. Current Snapshot: MvccSnapshot[applied={T|T < 7316280002242985984}]
I20260808 14:59:32.443979 3719 mvcc.cc:205] Tried to move back new op lower bound from 7316280002242985984 to 7316280002041548800. Current Snapshot: MvccSnapshot[applied={T|T < 7316280002242985984}]
I20260808 14:59:32.458997 2945 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:59:32.459290 2945 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:59:32.463438 2945 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Sending DeleteTablet for 3 replicas of tablet aa05486027ea429ca8fbcc6124680dc8
I20260808 14:59:32.464720 3571 tablet_service.cc:1514] Processing DeleteTablet for tablet aa05486027ea429ca8fbcc6124680dc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:59:32 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:52498
I20260808 14:59:32.464733 3149 tablet_service.cc:1514] Processing DeleteTablet for tablet aa05486027ea429ca8fbcc6124680dc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:59:32 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:51634
I20260808 14:59:32.465744 3356 tablet_service.cc:1514] Processing DeleteTablet for tablet aa05486027ea429ca8fbcc6124680dc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:59:32 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:53144
I20260808 14:59:32.466459 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 3034
I20260808 14:59:32.478952 3738 tablet_replica.cc:330] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4: stopping tablet replica
I20260808 14:59:32.479729 3734 tablet_replica.cc:330] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576: stopping tablet replica
I20260808 14:59:32.480242 3738 raft_consensus.cc:2229] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:59:32.480278 3734 raft_consensus.cc:2229] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:59:32.480829 3738 raft_consensus.cc:2258] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:59:32.481199 3734 raft_consensus.cc:2258] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:59:32.484019 3734 ts_tablet_manager.cc:1905] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:32.484431 3738 ts_tablet_manager.cc:1905] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:32.484678 3735 tablet_replica.cc:330] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6: stopping tablet replica
I20260808 14:59:32.485262 3735 raft_consensus.cc:2229] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:59:32.486526 3735 raft_consensus.cc:2258] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 08 14:59:32 dist-test-slave-z8x9 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:59:32.490474 3735 ts_tablet_manager.cc:1905] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:32.492091 3738 ts_tablet_manager.cc:1918] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:59:32.492318 3738 log.cc:1196] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/aa05486027ea429ca8fbcc6124680dc8
I20260808 14:59:32.493031 3738 ts_tablet_manager.cc:1939] T aa05486027ea429ca8fbcc6124680dc8 P c25aa19d27a5475389cbb463c20b6fb4: Deleting consensus metadata
I20260808 14:59:32.495038 2916 catalog_manager.cc:4841] TS c25aa19d27a5475389cbb463c20b6fb4 (127.12.73.130:39807): tablet aa05486027ea429ca8fbcc6124680dc8 (table test-table [id=6473d5a1b6c44922b06368df5e2a476d]) successfully deleted
I20260808 14:59:32.497013 3697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.467899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44372 (local address 127.12.73.129:38443)
0808 14:59:32.468167 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:32.468174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:32.475745 (+ 7571us) server_negotiation.cc:407] Connection header received
0808 14:59:32.475973 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:32.475979 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:32.476066 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:32.476182 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:32.478335 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.479601 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.481596 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.482359 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.482470 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.488441 (+ 5971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:32.488458 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:32.488479 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:32.488538 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:32.492952 (+ 4414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:32.494046 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:32.494057 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:32.494062 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:32.494250 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:32.494818 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:32.494824 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:32.494827 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:32.495315 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:32.495644 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:32.496336 (+ 692us) server_negotiation.cc:299] Negotiation successful
0808 14:59:32.496589 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:59:32.497489 3734 ts_tablet_manager.cc:1918] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:59:32.497745 3734 log.cc:1196] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/aa05486027ea429ca8fbcc6124680dc8
I20260808 14:59:32.498308 3234 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:32.498447 3734 ts_tablet_manager.cc:1939] T aa05486027ea429ca8fbcc6124680dc8 P c98d66bf6f43403ca4fead3d4ab01576: Deleting consensus metadata
I20260808 14:59:32.502988 3735 ts_tablet_manager.cc:1918] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:59:32.503180 3735 log.cc:1196] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/aa05486027ea429ca8fbcc6124680dc8
I20260808 14:59:32.503684 3735 ts_tablet_manager.cc:1939] T aa05486027ea429ca8fbcc6124680dc8 P 158e36f4831741dbb359144f59e937e6: Deleting consensus metadata
I20260808 14:59:32.505223 2922 catalog_manager.cc:4841] TS 158e36f4831741dbb359144f59e937e6 (127.12.73.131:34431): tablet aa05486027ea429ca8fbcc6124680dc8 (table test-table [id=6473d5a1b6c44922b06368df5e2a476d]) successfully deleted
I20260808 14:59:32.598418 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 3034
I20260808 14:59:32.599231 2922 catalog_manager.cc:4841] TS c98d66bf6f43403ca4fead3d4ab01576 (127.12.73.129:38443): tablet aa05486027ea429ca8fbcc6124680dc8 (table test-table [id=6473d5a1b6c44922b06368df5e2a476d]) successfully deleted
I20260808 14:59:32.623828 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 3247
Aug 08 14:59:32 dist-test-slave-z8x9 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:59:32.639357 3696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.624559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56262 (local address 127.12.73.130:39807)
0808 14:59:32.624755 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:32.624759 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:32.624833 (+ 74us) server_negotiation.cc:407] Connection header received
0808 14:59:32.625027 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:32.625033 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:32.625113 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:32.625323 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:32.626591 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.627362 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.628572 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.628954 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.629046 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.633623 (+ 4577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:32.633636 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:32.633651 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:32.633689 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:32.636603 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:32.637488 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:32.637496 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:32.637498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:32.637619 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:32.637969 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:32.637972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:32.637974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:32.638357 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:32.638574 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:32.638826 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 14:59:32.638983 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 14:59:32.640027 3445 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:32.734391 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 3247
I20260808 14:59:32.757505 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 3460
Aug 08 14:59:32 dist-test-slave-z8x9 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:59:32.773247 3700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:32.758249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53458 (local address 127.12.73.131:34431)
0808 14:59:32.758421 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:32.758426 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:32.758444 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:59:32.758592 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:32.758596 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:32.758661 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:32.758745 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:32.760044 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.760757 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.762052 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:32.762436 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:32.762525 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:32.766869 (+ 4344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:32.766884 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:32.766901 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:32.766938 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:32.770075 (+ 3137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:32.770741 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:32.770748 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:32.770751 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:32.770884 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:32.771254 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:32.771257 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:32.771260 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:32.771816 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:32.772150 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:32.772491 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 14:59:32.772730 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:59:32.774216 3664 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:32.865679 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 3460
I20260808 14:59:32.890602 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 2891
I20260808 14:59:32.891782 2993 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:33.006325 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 2891
I20260808 14:59:33.035574 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36059
--webserver_interface=127.12.73.190
--webserver_port=44057
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:36059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:33.371264 3744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:33.371582 3744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:33.371762 3744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:33.378742 3744 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:59:33.378880 3744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:33.378993 3744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:33.379101 3744 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:59:33.379191 3744 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:59:33.388494 3744 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:36059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=44057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:33.389737 3744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:33.391033 3744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:33.416733 3753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:33.416771 3759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:33.416815 3756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:33.417963 3744 server_base.cc:1034] running on GCE node
I20260808 14:59:33.418851 3744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:33.420472 3744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:33.421713 3744 hybrid_clock.cc:648] HybridClock initialized: now 1786201173421653 us; error 74 us; skew 500 ppm
I20260808 14:59:33.422120 3744 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:33 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201173, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:33.428310 3744 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:59:33.430080 3744 webserver.cc:460] Webserver started at http://127.12.73.190:44057/ using document root <none> and password file <none>
I20260808 14:59:33.430784 3744 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:33.430981 3744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:33.436733 3744 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:59:33.439684 3769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:33.441018 3744 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:59:33.441239 3744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe"
format_stamp: "Formatted at 2026-08-08 14:59:30 on dist-test-slave-z8x9"
server_key: "f732f10097b01c390323f47cfe4bc82f"
server_key_iv: "9478faaf92865d8fd01a1b35b6d8cea6"
server_key_version: "encryptionkey@0"
I20260808 14:59:33.442278 3744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:33.469225 3744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:33.473845 3744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:33.474066 3744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:33.493654 3744 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:36059
I20260808 14:59:33.493676 3846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:36059 every 8 connection(s)
I20260808 14:59:33.495244 3744 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:59:33.502226 3848 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:59:33.502511 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 3744
I20260808 14:59:33.503548 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:38443
--local_ip_for_outbound_sockets=127.12.73.129
--tserver_master_addrs=127.12.73.190:36059
--webserver_port=38221
--webserver_interface=127.12.73.129
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:59:33.507429 3848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Bootstrap starting.
I20260808 14:59:33.529712 3848 log.cc:824] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:33.542101 3848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:59:33.542667 3848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Bootstrap complete.
I20260808 14:59:33.552465 3848 raft_consensus.cc:348] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } }
I20260808 14:59:33.553354 3848 raft_consensus.cc:729] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d918ec859d1a4220a51b7e6fa2c3cdfe, State: Initialized, Role: FOLLOWER
I20260808 14:59:33.553963 3848 consensus_queue.cc:260] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } }
I20260808 14:59:33.554231 3848 raft_consensus.cc:388] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:59:33.554355 3848 raft_consensus.cc:482] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:59:33.554553 3848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:59:33.558526 3848 raft_consensus.cc:504] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } }
I20260808 14:59:33.559048 3848 leader_election.cc:302] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d918ec859d1a4220a51b7e6fa2c3cdfe; no voters:
I20260808 14:59:33.559759 3848 leader_election.cc:288] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:59:33.559887 3853 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:59:33.561470 3853 raft_consensus.cc:686] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 2 LEADER]: Becoming Leader. State: Replica: d918ec859d1a4220a51b7e6fa2c3cdfe, State: Running, Role: LEADER
I20260808 14:59:33.562077 3853 consensus_queue.cc:237] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } }
I20260808 14:59:33.562300 3848 sys_catalog.cc:564] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:59:33.564793 3855 sys_catalog.cc:455] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } } }
I20260808 14:59:33.565263 3855 sys_catalog.cc:458] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:33.570089 3856 sys_catalog.cc:455] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: SysCatalogTable state changed. Reason: New leader d918ec859d1a4220a51b7e6fa2c3cdfe. Latest consensus state: current_term: 2 leader_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } } }
I20260808 14:59:33.570474 3856 sys_catalog.cc:458] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:33.572896 3860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:59:33.580912 3860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:59:33.582312 3860 catalog_manager.cc:1259] Loaded cluster ID: fd86f255d0854f038aa87d49a0ae15c0
I20260808 14:59:33.582469 3860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:59:33.585872 3860 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 14:59:33.604610 3860 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 14:59:33.613761 3881 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:59:33.614202 3860 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:59:33.616236 3860 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Loaded TSK: 0
I20260808 14:59:33.617671 3860 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:59:33.861081 3850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:33.861419 3850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:33.861605 3850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:33.869112 3850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:33.869300 3850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:33.869516 3850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:59:33.879309 3850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:38443
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=38221
--tserver_master_addrs=127.12.73.190:36059
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:33.880544 3850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:33.881904 3850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:33.896368 3892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:33.896780 3891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:33.896605 3894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:33.897734 3850 server_base.cc:1034] running on GCE node
I20260808 14:59:33.898362 3850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:33.899322 3850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:33.900539 3850 hybrid_clock.cc:648] HybridClock initialized: now 1786201173900473 us; error 61 us; skew 500 ppm
I20260808 14:59:33.900861 3850 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:33 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201173, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:33.904197 3850 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:59:33.905858 3850 webserver.cc:460] Webserver started at http://127.12.73.129:38221/ using document root <none> and password file <none>
I20260808 14:59:33.906530 3850 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:33.906677 3850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:33.912215 3850 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 14:59:33.915077 3908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:33.916482 3850 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:59:33.916658 3850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "c98d66bf6f43403ca4fead3d4ab01576"
format_stamp: "Formatted at 2026-08-08 14:59:30 on dist-test-slave-z8x9"
server_key: "dd0d1af567b1cde85197253c7c514f4a"
server_key_iv: "1530635e28d2fb6dd73eb4256ede3727"
server_key_version: "encryptionkey@0"
I20260808 14:59:33.917681 3850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:33.931632 3850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:33.936192 3850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:33.936480 3850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:33.937651 3850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:33.939159 3850 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:33.939287 3850 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:33.939414 3850 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:33.939517 3850 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:33.976047 3850 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:38443
I20260808 14:59:33.976141 4101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:38443 every 8 connection(s)
I20260808 14:59:33.977675 3850 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:59:33.984786 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 3850
I20260808 14:59:33.985487 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:39807
--local_ip_for_outbound_sockets=127.12.73.130
--tserver_master_addrs=127.12.73.190:36059
--webserver_port=43815
--webserver_interface=127.12.73.130
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:59:33 dist-test-slave-z8x9 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201173, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:34.000584 4109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:33.980638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:57539)
0808 14:59:33.981420 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:33.981467 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:33.983120 (+ 1653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:33.984405 (+ 1285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:33.984418 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:33.985078 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:33.985750 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:33.985788 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:33.987374 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:33.987380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:33.988577 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:33.988590 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:33.989676 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:33.989685 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:33.989946 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:33.990626 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:33.990647 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:33.992773 (+ 2126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:33.996506 (+ 3733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:33.996513 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:33.996522 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:33.996951 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:33.997513 (+ 562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:33.997517 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:33.997520 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:33.997703 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:33.998667 (+ 964us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:33.998673 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:33.998943 (+ 270us) client_negotiation.cc:769] Sending connection context
0808 14:59:33.999193 (+ 250us) client_negotiation.cc:240] Negotiation successful
0808 14:59:33.999573 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":287,"threads_started":1}
I20260808 14:59:34.001133 4108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:33.980355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:57539 (local address 127.12.73.190:36059)
0808 14:59:33.981023 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:33.981042 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:33.981590 (+ 548us) server_negotiation.cc:407] Connection header received
0808 14:59:33.983634 (+ 2044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:33.983646 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:33.983925 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:33.984277 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:33.985999 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:33.987212 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:33.988722 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:33.989431 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:33.989640 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:33.993047 (+ 3407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:33.993054 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:33.993067 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:33.993102 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:33.996351 (+ 3249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:33.997092 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:33.997102 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:33.997110 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:33.997383 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:33.997821 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:33.997829 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:33.997834 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:33.998499 (+ 665us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:33.998691 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:33.999442 (+ 751us) server_negotiation.cc:299] Negotiation successful
0808 14:59:33.999866 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":299,"threads_started":1}
I20260808 14:59:34.003880 4102 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36059
I20260808 14:59:34.004181 4102 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:34.004917 4102 heartbeater.cc:511] Master 127.12.73.190:36059 requested a full tablet report, sending...
I20260808 14:59:34.007262 3790 ts_manager.cc:194] Registered new tserver with Master: c98d66bf6f43403ca4fead3d4ab01576 (127.12.73.129:38443)
I20260808 14:59:34.008749 3790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:57539
W20260808 14:59:34.327394 4110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:34.327713 4110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:34.327885 4110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:34.335132 4110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:34.335280 4110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:34.335457 4110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:59:34.345019 4110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:39807
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=43815
--tserver_master_addrs=127.12.73.190:36059
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:34.346493 4110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:34.347930 4110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:34.361250 4119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:34.361313 4120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:34.361215 4122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:34.362329 4110 server_base.cc:1034] running on GCE node
I20260808 14:59:34.363031 4110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:34.363957 4110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:34.365156 4110 hybrid_clock.cc:648] HybridClock initialized: now 1786201174365108 us; error 44 us; skew 500 ppm
I20260808 14:59:34.365533 4110 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:34 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:34.368765 4110 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:59:34.370174 4110 webserver.cc:460] Webserver started at http://127.12.73.130:43815/ using document root <none> and password file <none>
I20260808 14:59:34.370863 4110 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:34.371024 4110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:34.376359 4110 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 14:59:34.379021 4134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:34.380313 4110 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:59:34.380488 4110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "c25aa19d27a5475389cbb463c20b6fb4"
format_stamp: "Formatted at 2026-08-08 14:59:31 on dist-test-slave-z8x9"
server_key: "21204a4574f233351d4cc0477b5e80b4"
server_key_iv: "2782de51edd44ff4701327900c0b7d08"
server_key_version: "encryptionkey@0"
I20260808 14:59:34.381543 4110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:34.391718 4110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:34.395684 4110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:34.395992 4110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:34.397310 4110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:34.398734 4110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:34.398829 4110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:34.398991 4110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:34.399101 4110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:34.436218 4110 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:39807
I20260808 14:59:34.436277 4325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:39807 every 8 connection(s)
I20260808 14:59:34.438015 4110 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:59:34.447453 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 4110
I20260808 14:59:34.448233 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:34431
--local_ip_for_outbound_sockets=127.12.73.131
--tserver_master_addrs=127.12.73.190:36059
--webserver_port=32879
--webserver_interface=127.12.73.131
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:59:34 dist-test-slave-z8x9 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:34.459955 4108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:34.440574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:49815 (local address 127.12.73.190:36059)
0808 14:59:34.440757 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:34.440761 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:34.441999 (+ 1238us) server_negotiation.cc:407] Connection header received
0808 14:59:34.443833 (+ 1834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:34.443839 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:34.443931 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:34.444039 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:34.445615 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.446368 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.448596 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.449041 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.449143 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:34.453699 (+ 4556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:34.453703 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:34.453707 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:34.453739 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:34.456422 (+ 2683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:34.457485 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:34.457491 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:34.457494 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:34.457661 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:34.458160 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:34.458163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:34.458165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:34.458417 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:34.458527 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:34.459418 (+ 891us) server_negotiation.cc:299] Negotiation successful
0808 14:59:34.459591 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:59:34.461051 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:34.441056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:49815)
0808 14:59:34.441836 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:34.441880 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:34.443559 (+ 1679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:34.444310 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:34.444318 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:34.444824 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:34.445444 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:34.445463 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.446523 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.446533 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:34.448440 (+ 1907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:34.448459 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.449307 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.449317 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:34.449648 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:34.450416 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:34.450450 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:34.453477 (+ 3027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:34.456564 (+ 3087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:34.456576 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:34.456596 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:34.457320 (+ 724us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:34.457782 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:34.457790 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:34.457797 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:34.458047 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:34.458551 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:34.458562 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:34.459022 (+ 460us) client_negotiation.cc:769] Sending connection context
0808 14:59:34.459328 (+ 306us) client_negotiation.cc:240] Negotiation successful
0808 14:59:34.459897 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":296,"threads_started":1}
I20260808 14:59:34.462674 4326 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36059
I20260808 14:59:34.463039 4326 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:34.463833 4326 heartbeater.cc:511] Master 127.12.73.190:36059 requested a full tablet report, sending...
I20260808 14:59:34.465322 3790 ts_manager.cc:194] Registered new tserver with Master: c25aa19d27a5475389cbb463c20b6fb4 (127.12.73.130:39807)
I20260808 14:59:34.466127 3790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:49815
W20260808 14:59:34.792675 4329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:34.792945 4329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:34.793133 4329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:34.800583 4329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:34.800700 4329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:34.800911 4329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:59:34.810796 4329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:34431
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=32879
--tserver_master_addrs=127.12.73.190:36059
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:34.812130 4329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:34.813588 4329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:34.827260 4339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:34.827203 4342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:34.827316 4340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:34.828375 4329 server_base.cc:1034] running on GCE node
I20260808 14:59:34.828985 4329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:34.829983 4329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:34.831207 4329 hybrid_clock.cc:648] HybridClock initialized: now 1786201174831157 us; error 36 us; skew 500 ppm
I20260808 14:59:34.831529 4329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:34 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:34.834722 4329 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:59:34.836163 4329 webserver.cc:460] Webserver started at http://127.12.73.131:32879/ using document root <none> and password file <none>
I20260808 14:59:34.836779 4329 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:34.836897 4329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:34.842114 4329 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:59:34.845105 4354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:34.846596 4329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:59:34.846762 4329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "158e36f4831741dbb359144f59e937e6"
format_stamp: "Formatted at 2026-08-08 14:59:32 on dist-test-slave-z8x9"
server_key: "2a31400f1f6a82fb1ae9e5e8e4fcd297"
server_key_iv: "6409c08c621f8febfafd3b370de89956"
server_key_version: "encryptionkey@0"
I20260808 14:59:34.847875 4329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:34.863562 4329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:34.867447 4329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:34.867789 4329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:34.868769 4329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:34.870291 4329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:34.870388 4329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:34.870545 4329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:34.870641 4329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:34.904903 4329 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:34431
I20260808 14:59:34.904996 4546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:34431 every 8 connection(s)
I20260808 14:59:34.906406 4329 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:59:34.908464 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 4329
Aug 08 14:59:34 dist-test-slave-z8x9 krb5kdc[2876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:34.925366 4552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:34.909893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60078 (local address 127.12.73.190:36059)
0808 14:59:34.910406 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:34.910415 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:34.910436 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:59:34.910510 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:34.910515 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:34.910614 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:34.910732 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:34.912412 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.913620 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.915105 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.915533 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.915625 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:34.918767 (+ 3142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:34.918788 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:34.918792 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:34.918835 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:34.922067 (+ 3232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:34.923029 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:34.923036 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:34.923041 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:34.923212 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:34.923775 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:34.923778 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:34.923780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:34.924063 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:34.924322 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:34.924716 (+ 394us) server_negotiation.cc:299] Negotiation successful
0808 14:59:34.924957 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":420,"threads_started":1}
I20260808 14:59:34.929347 4108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:34.909139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:39393 (local address 127.12.73.190:36059)
0808 14:59:34.909371 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:34.909376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:34.911035 (+ 1659us) server_negotiation.cc:407] Connection header received
0808 14:59:34.913038 (+ 2003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:34.913042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:34.913099 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:34.913226 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:34.914764 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.915640 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.917423 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.918168 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.918301 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:34.922375 (+ 4074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:34.922380 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:34.922385 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:34.922421 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:34.926225 (+ 3804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:34.927026 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:34.927030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:34.927032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:34.927159 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:34.927677 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:34.927680 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:34.927682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:34.928073 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:34.928243 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:34.928899 (+ 656us) server_negotiation.cc:299] Negotiation successful
0808 14:59:34.929046 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 14:59:34.930299 4554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:34.909776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:39393)
0808 14:59:34.910882 (+ 1106us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:34.910929 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:34.912763 (+ 1834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:34.913462 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:34.913473 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:34.914057 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:34.914588 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:34.914604 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.915806 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.915813 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:34.917283 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:34.917296 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.918374 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.918379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:34.918571 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:34.919251 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:34.919294 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:34.922134 (+ 2840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:34.926367 (+ 4233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:34.926374 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:34.926384 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:34.926911 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:34.927277 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:34.927282 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:34.927286 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:34.927538 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:34.928214 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:34.928220 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:34.928530 (+ 310us) client_negotiation.cc:769] Sending connection context
0808 14:59:34.928749 (+ 219us) client_negotiation.cc:240] Negotiation successful
0808 14:59:34.929118 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"thread_start_us":583,"threads_started":1}
I20260808 14:59:34.931607 4548 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36059
I20260808 14:59:34.931910 4548 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:34.932644 4548 heartbeater.cc:511] Master 127.12.73.190:36059 requested a full tablet report, sending...
I20260808 14:59:34.934128 3790 ts_manager.cc:194] Registered new tserver with Master: 158e36f4831741dbb359144f59e937e6 (127.12.73.131:34431)
I20260808 14:59:34.934872 3790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:39393
I20260808 14:59:34.940179 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:59:34.946679 4108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:34.941053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60094 (local address 127.12.73.190:36059)
0808 14:59:34.941276 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:34.941280 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:34.941780 (+ 500us) server_negotiation.cc:407] Connection header received
0808 14:59:34.941949 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:34.941953 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:34.942070 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:34.942197 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:59:34.942571 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.943297 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.944682 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.945103 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.945309 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:34.945720 (+ 411us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:59:34.946216 (+ 496us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:59:34.946345 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:34.946447 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 14:59:34.946508 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:59:34.947577 3790 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:60094:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:59:34.955042 3790 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:59:34.994225 4569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:34.967384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56266 (local address 127.12.73.130:39807)
0808 14:59:34.980255 (+ 12871us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:34.980269 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:34.984185 (+ 3916us) server_negotiation.cc:407] Connection header received
0808 14:59:34.984992 (+ 807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:34.985000 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:34.985345 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:34.985536 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:34.987072 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.988677 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.991381 (+ 2704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.992720 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.992865 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:34.993323 (+ 458us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:34.993691 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 14:59:34.993869 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12615,"thread_start_us":12900,"threads_started":1}
I20260808 14:59:34.994306 4567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:34.966841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:39807 (local address 127.0.0.1:56266)
0808 14:59:34.984015 (+ 17174us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:34.984039 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:34.984785 (+ 746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:34.986346 (+ 1561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:34.986358 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:34.986396 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:34.986841 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:34.986882 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.988854 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.988860 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:34.991210 (+ 2350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:34.991234 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.993314 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.993320 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:34.993474 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:34.993507 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 14:59:34.993653 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 14:59:34.993867 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17012,"mutex_wait_us":1,"thread_start_us":17385,"threads_started":1}
I20260808 14:59:34.995271 4573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:34.985768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38443 (local address 127.0.0.1:44388)
0808 14:59:34.986756 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:34.986792 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:34.986963 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:34.987646 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:34.987651 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:34.987677 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:34.988093 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:34.988104 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.989991 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.989998 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:34.992064 (+ 2066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:34.992079 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.994323 (+ 2244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.994331 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:34.994494 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:34.994541 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 14:59:34.994619 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:59:34.994772 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"mutex_wait_us":29,"thread_start_us":597,"threads_started":1}
I20260808 14:59:34.995553 4566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:34.966673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:34431 (local address 127.0.0.1:53474)
0808 14:59:34.981115 (+ 14442us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:34.981195 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:34.981389 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:34.988085 (+ 6696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:34.988089 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:34.988113 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:34.988534 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:34.988548 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.990746 (+ 2198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.990752 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:34.992840 (+ 2088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:34.992854 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.994735 (+ 1881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.994741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:34.994935 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:34.994967 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 14:59:34.995034 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:59:34.995177 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14211,"thread_start_us":14076,"threads_started":1}
I20260808 14:59:34.995893 4571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:34.982063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44388 (local address 127.12.73.129:38443)
0808 14:59:34.985734 (+ 3671us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:34.985742 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:34.986928 (+ 1186us) server_negotiation.cc:407] Connection header received
0808 14:59:34.987222 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:34.987230 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:34.987455 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:34.987648 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:34.988358 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.989853 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.992254 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.993794 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.993931 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:34.995004 (+ 1073us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:34.995082 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 14:59:34.995254 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3496,"thread_start_us":3360,"threads_started":1}
I20260808 14:59:34.996512 4568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:34.966962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53474 (local address 127.12.73.131:34431)
0808 14:59:34.987534 (+ 20572us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:34.987542 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:34.987572 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:59:34.987661 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:34.987668 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:34.987863 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:34.988050 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:34.988743 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.990586 (+ 1843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.993030 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:34.994474 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:34.995755 (+ 1281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:34.995980 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:34.996053 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 14:59:34.996213 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20391,"thread_start_us":20232,"threads_started":1}
I20260808 14:59:34.999068 3994 tablet_service.cc:1467] Processing CreateTablet for tablet 24336939c5ce4614a2ed9b44b90bed78 (DEFAULT_TABLE table=test-table [id=0b81f90b7342442f9235aabca0eb1658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:59:34.998905 4217 tablet_service.cc:1467] Processing CreateTablet for tablet 24336939c5ce4614a2ed9b44b90bed78 (DEFAULT_TABLE table=test-table [id=0b81f90b7342442f9235aabca0eb1658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:59:35.000267 3994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24336939c5ce4614a2ed9b44b90bed78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:35.000351 4217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24336939c5ce4614a2ed9b44b90bed78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:35.000598 4437 tablet_service.cc:1467] Processing CreateTablet for tablet 24336939c5ce4614a2ed9b44b90bed78 (DEFAULT_TABLE table=test-table [id=0b81f90b7342442f9235aabca0eb1658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:59:35.001938 4437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24336939c5ce4614a2ed9b44b90bed78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:35.011623 4102 heartbeater.cc:503] Master 127.12.73.190:36059 was elected leader, sending a full tablet report...
I20260808 14:59:35.011976 4575 tablet_bootstrap.cc:492] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: Bootstrap starting.
I20260808 14:59:35.016047 4575 tablet_bootstrap.cc:654] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:35.017707 4575 log.cc:824] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:35.022097 4576 tablet_bootstrap.cc:492] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4: Bootstrap starting.
I20260808 14:59:35.025403 4578 tablet_bootstrap.cc:492] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6: Bootstrap starting.
I20260808 14:59:35.026149 4576 tablet_bootstrap.cc:654] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:35.027145 4576 log.cc:824] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:35.029625 4578 tablet_bootstrap.cc:654] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:35.029750 4576 tablet_bootstrap.cc:492] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4: No bootstrap required, opened a new log
I20260808 14:59:35.029997 4576 ts_tablet_manager.cc:1397] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260808 14:59:35.031117 4578 log.cc:824] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:35.034145 4575 tablet_bootstrap.cc:492] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: No bootstrap required, opened a new log
I20260808 14:59:35.034435 4575 ts_tablet_manager.cc:1397] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.008s
I20260808 14:59:35.034796 4578 tablet_bootstrap.cc:492] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6: No bootstrap required, opened a new log
I20260808 14:59:35.035053 4578 ts_tablet_manager.cc:1397] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260808 14:59:35.038084 4576 raft_consensus.cc:348] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } } peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } }
I20260808 14:59:35.038453 4576 raft_consensus.cc:374] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:35.038589 4576 raft_consensus.cc:729] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25aa19d27a5475389cbb463c20b6fb4, State: Initialized, Role: FOLLOWER
I20260808 14:59:35.039191 4576 consensus_queue.cc:260] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } } peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } }
I20260808 14:59:35.040277 4326 heartbeater.cc:503] Master 127.12.73.190:36059 was elected leader, sending a full tablet report...
I20260808 14:59:35.040966 4576 ts_tablet_manager.cc:1428] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260808 14:59:35.045238 4575 raft_consensus.cc:348] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } } peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } }
I20260808 14:59:35.045692 4575 raft_consensus.cc:374] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:35.045805 4575 raft_consensus.cc:729] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98d66bf6f43403ca4fead3d4ab01576, State: Initialized, Role: FOLLOWER
I20260808 14:59:35.045909 4578 raft_consensus.cc:348] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } } peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } }
I20260808 14:59:35.046309 4578 raft_consensus.cc:374] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:35.046411 4578 raft_consensus.cc:729] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158e36f4831741dbb359144f59e937e6, State: Initialized, Role: FOLLOWER
I20260808 14:59:35.046434 4575 consensus_queue.cc:260] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } } peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } }
I20260808 14:59:35.046998 4578 consensus_queue.cc:260] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } } peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } }
I20260808 14:59:35.048346 4575 ts_tablet_manager.cc:1428] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260808 14:59:35.048462 4548 heartbeater.cc:503] Master 127.12.73.190:36059 was elected leader, sending a full tablet report...
I20260808 14:59:35.048884 4578 ts_tablet_manager.cc:1428] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260808 14:59:35.062772 4587 raft_consensus.cc:482] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:59:35.063026 4587 raft_consensus.cc:504] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } } peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } }
I20260808 14:59:35.064721 4587 leader_election.cc:288] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 158e36f4831741dbb359144f59e937e6 (127.12.73.131:34431), c25aa19d27a5475389cbb463c20b6fb4 (127.12.73.130:39807)
I20260808 14:59:35.071352 4568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.065223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:39407 (local address 127.12.73.131:34431)
0808 14:59:35.065411 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:35.065420 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:35.065754 (+ 334us) server_negotiation.cc:407] Connection header received
0808 14:59:35.066109 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:35.066113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:35.066172 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:35.066267 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:35.066812 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.067684 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.069641 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.070417 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.070602 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:35.070678 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:35.070961 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 14:59:35.071081 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:59:35.071430 4590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.064853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:34431 (local address 127.12.73.129:39407)
0808 14:59:35.065620 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:35.065650 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:35.065891 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:35.066284 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:35.066288 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:35.066322 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:35.066672 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:35.066683 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.067810 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.067817 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:35.069490 (+ 1673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:35.069502 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.070622 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.070629 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:35.070797 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:35.070821 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:59:35.070924 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 14:59:35.071052 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":394,"threads_started":1}
I20260808 14:59:35.071497 4569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.065775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:48423 (local address 127.12.73.130:39807)
0808 14:59:35.065978 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:35.065984 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:35.066134 (+ 150us) server_negotiation.cc:407] Connection header received
0808 14:59:35.066335 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:35.066339 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:35.066394 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:35.066494 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:35.067070 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.067857 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.069808 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.070576 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.070750 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:35.070835 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:35.071102 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 14:59:35.071235 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:59:35.071918 4591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.065209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:39807 (local address 127.12.73.129:48423)
0808 14:59:35.066028 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:35.066053 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:35.066196 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:35.066515 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:35.066519 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:35.066545 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:35.066920 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:35.066929 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.068002 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.068008 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:35.069661 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:35.069674 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.070803 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.070810 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:35.070952 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:35.070974 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:59:35.071077 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 14:59:35.071201 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":533,"threads_started":1}
I20260808 14:59:35.072379 4465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24336939c5ce4614a2ed9b44b90bed78" candidate_uuid: "c98d66bf6f43403ca4fead3d4ab01576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158e36f4831741dbb359144f59e937e6" is_pre_election: true
I20260808 14:59:35.072935 4465 raft_consensus.cc:2454] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98d66bf6f43403ca4fead3d4ab01576 in term 0.
I20260808 14:59:35.072909 4250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24336939c5ce4614a2ed9b44b90bed78" candidate_uuid: "c98d66bf6f43403ca4fead3d4ab01576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25aa19d27a5475389cbb463c20b6fb4" is_pre_election: true
I20260808 14:59:35.073436 4250 raft_consensus.cc:2454] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98d66bf6f43403ca4fead3d4ab01576 in term 0.
I20260808 14:59:35.073738 3913 leader_election.cc:302] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 158e36f4831741dbb359144f59e937e6, c98d66bf6f43403ca4fead3d4ab01576; no voters:
I20260808 14:59:35.074178 4587 raft_consensus.cc:2781] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:59:35.074321 4587 raft_consensus.cc:482] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:59:35.074435 4587 raft_consensus.cc:3037] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:35.076690 4587 raft_consensus.cc:504] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } } peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } }
I20260808 14:59:35.077375 4587 leader_election.cc:288] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [CANDIDATE]: Term 1 election: Requested vote from peers 158e36f4831741dbb359144f59e937e6 (127.12.73.131:34431), c25aa19d27a5475389cbb463c20b6fb4 (127.12.73.130:39807)
I20260808 14:59:35.077888 4465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24336939c5ce4614a2ed9b44b90bed78" candidate_uuid: "c98d66bf6f43403ca4fead3d4ab01576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158e36f4831741dbb359144f59e937e6"
I20260808 14:59:35.077930 4250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24336939c5ce4614a2ed9b44b90bed78" candidate_uuid: "c98d66bf6f43403ca4fead3d4ab01576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25aa19d27a5475389cbb463c20b6fb4"
I20260808 14:59:35.078099 4465 raft_consensus.cc:3037] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:35.078197 4250 raft_consensus.cc:3037] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:35.080351 4465 raft_consensus.cc:2454] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98d66bf6f43403ca4fead3d4ab01576 in term 1.
I20260808 14:59:35.080514 4250 raft_consensus.cc:2454] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98d66bf6f43403ca4fead3d4ab01576 in term 1.
I20260808 14:59:35.080782 3913 leader_election.cc:302] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 158e36f4831741dbb359144f59e937e6, c98d66bf6f43403ca4fead3d4ab01576; no voters:
I20260808 14:59:35.081054 4587 raft_consensus.cc:2781] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:59:35.081532 4587 raft_consensus.cc:686] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 1 LEADER]: Becoming Leader. State: Replica: c98d66bf6f43403ca4fead3d4ab01576, State: Running, Role: LEADER
I20260808 14:59:35.081997 4587 consensus_queue.cc:237] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } } peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } }
I20260808 14:59:35.086689 3789 catalog_manager.cc:5495] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98d66bf6f43403ca4fead3d4ab01576 (127.12.73.129). New cstate: current_term: 1 leader_uuid: "c98d66bf6f43403ca4fead3d4ab01576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c98d66bf6f43403ca4fead3d4ab01576" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38443 } health_report { overall_health: HEALTHY } } }
I20260808 14:59:35.121025 4571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.115709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44390 (local address 127.12.73.129:38443)
0808 14:59:35.115937 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:35.115946 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:35.115967 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:59:35.116068 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:35.116072 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:35.116157 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:35.116313 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:59:35.116711 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.117539 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.118882 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.119285 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.119420 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:35.119923 (+ 503us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:59:35.120407 (+ 484us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:59:35.120566 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:35.120644 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 14:59:35.120736 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:59:35.129233 4465 raft_consensus.cc:1261] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6 [term 1 FOLLOWER]: Refusing update from remote peer c98d66bf6f43403ca4fead3d4ab01576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:59:35.129238 4250 raft_consensus.cc:1261] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4 [term 1 FOLLOWER]: Refusing update from remote peer c98d66bf6f43403ca4fead3d4ab01576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:59:35.130199 4592 consensus_queue.cc:1035] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25aa19d27a5475389cbb463c20b6fb4" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 39807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:59:35.130596 4587 consensus_queue.cc:1035] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158e36f4831741dbb359144f59e937e6" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:59:35.155917 3789 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:60094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:59:35.156229 3789 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:60094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:59:35.159952 3789 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Sending DeleteTablet for 3 replicas of tablet 24336939c5ce4614a2ed9b44b90bed78
I20260808 14:59:35.161226 4217 tablet_service.cc:1514] Processing DeleteTablet for tablet 24336939c5ce4614a2ed9b44b90bed78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:59:35 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:56266
I20260808 14:59:35.161226 4437 tablet_service.cc:1514] Processing DeleteTablet for tablet 24336939c5ce4614a2ed9b44b90bed78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:59:35 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:53474
I20260808 14:59:35.161791 3994 tablet_service.cc:1514] Processing DeleteTablet for tablet 24336939c5ce4614a2ed9b44b90bed78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:59:35 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:44388
I20260808 14:59:35.163118 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 3850
I20260808 14:59:35.172232 4612 tablet_replica.cc:330] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6: stopping tablet replica
I20260808 14:59:35.172847 4612 raft_consensus.cc:2229] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:59:35.173624 4612 raft_consensus.cc:2258] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:59:35.176076 4612 ts_tablet_manager.cc:1905] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:35.183457 4612 ts_tablet_manager.cc:1918] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:59:35.184206 4610 tablet_replica.cc:330] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4: stopping tablet replica
I20260808 14:59:35.184784 4610 raft_consensus.cc:2229] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:59:35.185436 4610 raft_consensus.cc:2258] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:59:35.186000 4612 log.cc:1196] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/24336939c5ce4614a2ed9b44b90bed78
I20260808 14:59:35.187639 4610 ts_tablet_manager.cc:1905] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:35.189608 4613 tablet_replica.cc:330] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: stopping tablet replica
I20260808 14:59:35.190163 4613 raft_consensus.cc:2229] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:59:35.190948 4613 raft_consensus.cc:2258] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:59:35.191622 4612 ts_tablet_manager.cc:1939] T 24336939c5ce4614a2ed9b44b90bed78 P 158e36f4831741dbb359144f59e937e6: Deleting consensus metadata
I20260808 14:59:35.193324 4613 ts_tablet_manager.cc:1905] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:35.195158 4571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.164040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44392 (local address 127.12.73.129:38443)
0808 14:59:35.164784 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:35.164794 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:35.164817 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:59:35.164921 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:35.164929 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:35.165023 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:35.165136 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:35.167788 (+ 2652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.169476 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.172246 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.173254 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.173405 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:35.184339 (+ 10934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:35.184360 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:35.184385 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:35.184440 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:35.190506 (+ 6066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:35.191623 (+ 1117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:35.191632 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:35.191635 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:35.191863 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:35.192397 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:35.192402 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:35.192405 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:35.192855 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:35.194303 (+ 1448us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:35.194461 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 14:59:35.194716 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560}
I20260808 14:59:35.195343 3774 catalog_manager.cc:4841] TS 158e36f4831741dbb359144f59e937e6 (127.12.73.131:34431): tablet 24336939c5ce4614a2ed9b44b90bed78 (table test-table [id=0b81f90b7342442f9235aabca0eb1658]) successfully deleted
I20260808 14:59:35.196044 4096 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:35.199005 4610 ts_tablet_manager.cc:1918] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:59:35.199174 4610 log.cc:1196] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/24336939c5ce4614a2ed9b44b90bed78
I20260808 14:59:35.199762 4610 ts_tablet_manager.cc:1939] T 24336939c5ce4614a2ed9b44b90bed78 P c25aa19d27a5475389cbb463c20b6fb4: Deleting consensus metadata
I20260808 14:59:35.201390 3770 catalog_manager.cc:4841] TS c25aa19d27a5475389cbb463c20b6fb4 (127.12.73.130:39807): tablet 24336939c5ce4614a2ed9b44b90bed78 (table test-table [id=0b81f90b7342442f9235aabca0eb1658]) successfully deleted
I20260808 14:59:35.295248 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 3850
W20260808 14:59:35.320688 3774 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.73.129:38443 (error 108)
I20260808 14:59:35.320943 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 4110
I20260808 14:59:35.322841 4566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.322319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38443 (local address 127.0.0.1:44408)
0808 14:59:35.322500 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:35.322632 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:38443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 14:59:35.323115 3774 catalog_manager.cc:4584] TS c98d66bf6f43403ca4fead3d4ab01576 (127.12.73.129:38443): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 24336939c5ce4614a2ed9b44b90bed78: Network error: Client connection negotiation failed: client connection to 127.12.73.129:38443: connect: Connection refused (error 111)
I20260808 14:59:35.334824 4569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.321779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56278 (local address 127.12.73.130:39807)
0808 14:59:35.321983 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:35.321988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:35.322073 (+ 85us) server_negotiation.cc:407] Connection header received
0808 14:59:35.322298 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:35.322304 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:35.322403 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:35.322515 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:35.324055 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.324801 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.326137 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.326512 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.326604 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:35.329142 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:35.329154 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:35.329243 (+ 89us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:35.329293 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:35.332172 (+ 2879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:35.332914 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:35.332921 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:35.332923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:35.333047 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:35.333460 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:35.333463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:35.333465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:35.333825 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:35.334026 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:35.334309 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 14:59:35.334460 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:59:35.335556 4319 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:35.376866 4566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.376310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38443 (local address 127.0.0.1:44424)
0808 14:59:35.376541 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:35.376667 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:38443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 14:59:35.377923 4566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.377527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38443 (local address 127.0.0.1:44428)
0808 14:59:35.377678 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:35.377769 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:38443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 14:59:35.427676 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 4110
I20260808 14:59:35.438333 4566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.437753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38443 (local address 127.0.0.1:44438)
0808 14:59:35.437998 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:35.438116 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:38443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 14:59:35.439445 4566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.439014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38443 (local address 127.0.0.1:44448)
0808 14:59:35.439189 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:35.439287 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:38443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 14:59:35.454973 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 4329
I20260808 14:59:35.468454 4568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.455746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53476 (local address 127.12.73.131:34431)
0808 14:59:35.455952 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:35.455957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:35.455977 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:59:35.456124 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:35.456127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:35.456208 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:35.456328 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:35.457666 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.458390 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.459752 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:35.460127 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:35.460216 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:35.462854 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:35.462869 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:35.462885 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:35.462923 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:35.465912 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:35.466526 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:35.466533 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:35.466535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:35.466656 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:35.466965 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:35.466969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:35.466971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:35.467413 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:35.467636 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:35.467850 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 14:59:35.468071 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:59:35.469118 4542 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:35.519783 4566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.519313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38443 (local address 127.0.0.1:44464)
0808 14:59:35.519524 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:35.519613 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:38443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 14:59:35.520788 4566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.520418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38443 (local address 127.0.0.1:44468)
0808 14:59:35.520614 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:35.520682 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:38443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 14:59:35.557920 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 4329
I20260808 14:59:35.583091 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 3744
I20260808 14:59:35.584220 3838 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:35.697916 4566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:35.697153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38443 (local address 127.0.0.1:44474)
0808 14:59:35.697453 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:35.697591 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:38443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 14:59:35.698119 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 3744
I20260808 14:59:35.728920 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36059
--webserver_interface=127.12.73.190
--webserver_port=44057
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:36059
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:36.073276 4621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:36.073585 4621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:36.073678 4621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:36.081755 4621 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:59:36.081898 4621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:36.081951 4621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:36.082018 4621 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:59:36.082064 4621 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:59:36.092218 4621 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:36059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=44057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:36.093603 4621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:36.095222 4621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:36.107916 4633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:36.107982 4634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:36.107960 4638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:36.108933 4621 server_base.cc:1034] running on GCE node
I20260808 14:59:36.109922 4621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:36.111399 4621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:36.112640 4621 hybrid_clock.cc:648] HybridClock initialized: now 1786201176112594 us; error 56 us; skew 500 ppm
I20260808 14:59:36.113003 4621 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:36 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201176, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:36.116441 4621 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:59:36.118028 4621 webserver.cc:460] Webserver started at http://127.12.73.190:44057/ using document root <none> and password file <none>
I20260808 14:59:36.118748 4621 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:36.118908 4621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:36.124364 4621 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 14:59:36.127259 4652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:36.128512 4621 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:59:36.128702 4621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe"
format_stamp: "Formatted at 2026-08-08 14:59:30 on dist-test-slave-z8x9"
server_key: "f732f10097b01c390323f47cfe4bc82f"
server_key_iv: "9478faaf92865d8fd01a1b35b6d8cea6"
server_key_version: "encryptionkey@0"
I20260808 14:59:36.129776 4621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:36.144459 4621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:36.148298 4621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:36.148602 4621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:36.167624 4621 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:36059
I20260808 14:59:36.167644 4746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:36059 every 8 connection(s)
I20260808 14:59:36.169325 4621 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:59:36.175957 4747 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:59:36.176429 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 4621
I20260808 14:59:36.177363 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:38443
--local_ip_for_outbound_sockets=127.12.73.129
--tserver_master_addrs=127.12.73.190:36059
--webserver_port=38221
--webserver_interface=127.12.73.129
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:59:36.179504 4747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Bootstrap starting.
I20260808 14:59:36.199748 4747 log.cc:824] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:36.215328 4747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:59:36.215874 4747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe: Bootstrap complete.
I20260808 14:59:36.225003 4747 raft_consensus.cc:348] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } }
I20260808 14:59:36.225997 4747 raft_consensus.cc:729] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d918ec859d1a4220a51b7e6fa2c3cdfe, State: Initialized, Role: FOLLOWER
I20260808 14:59:36.226576 4747 consensus_queue.cc:260] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } }
I20260808 14:59:36.226820 4747 raft_consensus.cc:388] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:59:36.226958 4747 raft_consensus.cc:482] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:59:36.227147 4747 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:59:36.230893 4747 raft_consensus.cc:504] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } }
I20260808 14:59:36.231395 4747 leader_election.cc:302] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d918ec859d1a4220a51b7e6fa2c3cdfe; no voters:
I20260808 14:59:36.232090 4747 leader_election.cc:288] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 14:59:36.232234 4755 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:59:36.233783 4755 raft_consensus.cc:686] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [term 3 LEADER]: Becoming Leader. State: Replica: d918ec859d1a4220a51b7e6fa2c3cdfe, State: Running, Role: LEADER
I20260808 14:59:36.234426 4755 consensus_queue.cc:237] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } }
I20260808 14:59:36.234627 4747 sys_catalog.cc:564] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:59:36.237102 4759 sys_catalog.cc:455] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } } }
I20260808 14:59:36.237536 4759 sys_catalog.cc:458] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:36.242229 4760 sys_catalog.cc:455] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: SysCatalogTable state changed. Reason: New leader d918ec859d1a4220a51b7e6fa2c3cdfe. Latest consensus state: current_term: 3 leader_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d918ec859d1a4220a51b7e6fa2c3cdfe" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36059 } } }
I20260808 14:59:36.242532 4760 sys_catalog.cc:458] T 00000000000000000000000000000000 P d918ec859d1a4220a51b7e6fa2c3cdfe [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:36.245092 4765 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:59:36.255317 4765 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:59:36.257241 4765 catalog_manager.cc:1259] Loaded cluster ID: fd86f255d0854f038aa87d49a0ae15c0
I20260808 14:59:36.257359 4765 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 14:59:36.260178 4765 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f272a3439ad google::LogMessage::Fail() at ??:0
@ 0x7f272a34688a google::LogMessage::SendToLog() at ??:0
@ 0x7f272a3434de google::LogMessage::Flush() at ??:0
@ 0x7f272a344a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f273fd76512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
I20260808 14:59:36.277304 4785 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f273fd73976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f273fdfb610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f273fdfb439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f272cf8f345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f272cf9291c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f272cf92799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f272cf6deaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f27302476db start_thread at ??:0
@ 0x7f27291dd61f clone at ??:0
W20260808 14:59:36.585430 4753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:36.585712 4753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:36.585875 4753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:36.592989 4753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:36.593083 4753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:36.593266 4753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:59:36.602677 4753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:38443
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=38221
--tserver_master_addrs=127.12.73.190:36059
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:36.603986 4753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:36.605331 4753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:36.618435 4819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:36.618484 4820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:36.618531 4823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:36.619248 4753 server_base.cc:1034] running on GCE node
I20260808 14:59:36.619868 4753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:36.620719 4753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:36.621914 4753 hybrid_clock.cc:648] HybridClock initialized: now 1786201176621881 us; error 28 us; skew 500 ppm
I20260808 14:59:36.622220 4753 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:36 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201176, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:36.625509 4753 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:59:36.626883 4753 webserver.cc:460] Webserver started at http://127.12.73.129:38221/ using document root <none> and password file <none>
I20260808 14:59:36.627579 4753 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:36.627734 4753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:36.632848 4753 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:59:36.635779 4837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:36.637025 4753 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:59:36.637260 4753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "c98d66bf6f43403ca4fead3d4ab01576"
format_stamp: "Formatted at 2026-08-08 14:59:30 on dist-test-slave-z8x9"
server_key: "dd0d1af567b1cde85197253c7c514f4a"
server_key_iv: "1530635e28d2fb6dd73eb4256ede3727"
server_key_version: "encryptionkey@0"
I20260808 14:59:36.638204 4753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:36.664191 4753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:36.669507 4753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:36.669787 4753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:36.670786 4753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:36.672827 4852 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260808 14:59:36.679669 4852 ts_tablet_manager.cc:1852] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 14:59:36.680711 4852 ts_tablet_manager.cc:1905] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:36.687987 4852 ts_tablet_manager.cc:1918] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:59:36.688200 4852 log.cc:1196] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/24336939c5ce4614a2ed9b44b90bed78
I20260808 14:59:36.688740 4852 ts_tablet_manager.cc:1939] T 24336939c5ce4614a2ed9b44b90bed78 P c98d66bf6f43403ca4fead3d4ab01576: Deleting consensus metadata
I20260808 14:59:36.689144 4753 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 14:59:36.689354 4753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.017s user 0.001s sys 0.000s
I20260808 14:59:36.689502 4753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:36.689596 4753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:36.724802 4753 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:38443
I20260808 14:59:36.724893 5031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:38443 every 8 connection(s)
I20260808 14:59:36.726182 4753 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:59:36.731009 5036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:36.729225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:56669)
0808 14:59:36.729950 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:36.730182 (+ 232us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":277,"threads_started":1}
W20260808 14:59:36.731721 5033 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:36059 (0 consecutive failures): Network error: Failed to ping master at 127.12.73.190:36059: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
I20260808 14:59:36.732156 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 4753
I20260808 14:59:36.732687 5036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:36.732239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:41877)
0808 14:59:36.732452 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:36.732540 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 14:59:36.732973 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:39807
--local_ip_for_outbound_sockets=127.12.73.130
--tserver_master_addrs=127.12.73.190:36059
--webserver_port=43815
--webserver_interface=127.12.73.130
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:59:36.733709 5036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:36.733357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:49779)
0808 14:59:36.733500 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:36.733588 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 14:59:36.734012 5033 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:59:37.066439 5038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:37.066740 5038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:37.066927 5038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:37.074252 5038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:37.074368 5038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:37.074584 5038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:59:37.084259 5038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:39807
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=43815
--tserver_master_addrs=127.12.73.190:36059
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:37.085626 5038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:37.086951 5038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:37.100675 5054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:37.100740 5049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:37.100716 5052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:37.101847 5038 server_base.cc:1034] running on GCE node
I20260808 14:59:37.102445 5038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:37.103343 5038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:37.104611 5038 hybrid_clock.cc:648] HybridClock initialized: now 1786201177104554 us; error 53 us; skew 500 ppm
I20260808 14:59:37.105041 5038 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:37 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201177, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:37.108388 5038 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:59:37.109895 5038 webserver.cc:460] Webserver started at http://127.12.73.130:43815/ using document root <none> and password file <none>
I20260808 14:59:37.110539 5038 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:37.110677 5038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:37.115907 5038 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 14:59:37.118578 5064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:37.119872 5038 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:59:37.120059 5038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "c25aa19d27a5475389cbb463c20b6fb4"
format_stamp: "Formatted at 2026-08-08 14:59:31 on dist-test-slave-z8x9"
server_key: "21204a4574f233351d4cc0477b5e80b4"
server_key_iv: "2782de51edd44ff4701327900c0b7d08"
server_key_version: "encryptionkey@0"
I20260808 14:59:37.121034 5038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:37.145727 5038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:37.149629 5038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:37.149909 5038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:37.150907 5038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:37.152215 5038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:37.152341 5038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:37.152472 5038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:37.152567 5038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:37.186515 5038 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:39807
I20260808 14:59:37.186609 5255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:39807 every 8 connection(s)
I20260808 14:59:37.187995 5038 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:59:37.192309 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 5038
I20260808 14:59:37.192873 5259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:37.191030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:60571)
0808 14:59:37.191755 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:37.191987 (+ 232us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":275,"threads_started":1}
I20260808 14:59:37.192906 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:34431
--local_ip_for_outbound_sockets=127.12.73.131
--tserver_master_addrs=127.12.73.190:36059
--webserver_port=32879
--webserver_interface=127.12.73.131
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:37.193699 5256 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:36059 (0 consecutive failures): Network error: Failed to ping master at 127.12.73.190:36059: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
I20260808 14:59:37.194722 5259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:37.194268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:46027)
0808 14:59:37.194460 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:37.194560 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 14:59:37.195746 5259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:37.195305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:32773)
0808 14:59:37.195485 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:37.195588 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 14:59:37.196064 5256 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:59:37.531358 5260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:37.531658 5260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:37.531757 5260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:37.539024 5260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:37.539143 5260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:37.539264 5260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:59:37.549245 5260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:34431
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=32879
--tserver_master_addrs=127.12.73.190:36059
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:37.550637 5260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:37.551910 5260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:37.565028 5267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:37.565069 5272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:37.565117 5276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:37.565922 5260 server_base.cc:1034] running on GCE node
I20260808 14:59:37.566637 5260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:37.567625 5260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:37.568830 5260 hybrid_clock.cc:648] HybridClock initialized: now 1786201177568742 us; error 71 us; skew 500 ppm
I20260808 14:59:37.569150 5260 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:37 dist-test-slave-z8x9 krb5kdc[2876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201177, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:37.572434 5260 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:59:37.574019 5260 webserver.cc:460] Webserver started at http://127.12.73.131:32879/ using document root <none> and password file <none>
I20260808 14:59:37.574733 5260 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:37.574887 5260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:37.580179 5260 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 14:59:37.582958 5287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:37.584187 5260 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:59:37.584380 5260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "158e36f4831741dbb359144f59e937e6"
format_stamp: "Formatted at 2026-08-08 14:59:32 on dist-test-slave-z8x9"
server_key: "2a31400f1f6a82fb1ae9e5e8e4fcd297"
server_key_iv: "6409c08c621f8febfafd3b370de89956"
server_key_version: "encryptionkey@0"
I20260808 14:59:37.585436 5260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:37.608587 5260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:37.612648 5260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:37.612939 5260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:37.613976 5260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:37.615337 5260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:37.615473 5260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:37.615608 5260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:37.615698 5260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:37.649845 5260 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:34431
I20260808 14:59:37.649940 5461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:34431 every 8 connection(s)
I20260808 14:59:37.651353 5260 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:59:37.652594 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 5260
I20260808 14:59:37.656559 5468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:37.654786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:60069)
0808 14:59:37.655498 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:37.655734 (+ 236us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":280,"threads_started":1}
W20260808 14:59:37.657357 5463 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:36059 (0 consecutive failures): Network error: Failed to ping master at 127.12.73.190:36059: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
I20260808 14:59:37.658131 5468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:37.657805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:34595)
0808 14:59:37.657965 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:37.658030 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 14:59:37.658957 5468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:37.658623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:36039)
0808 14:59:37.658762 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:37.658850 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 14:59:37.659193 5463 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:59:37.735406 5470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:37.734567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:54639)
0808 14:59:37.735040 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:37.735134 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":226,"threads_started":1}
I20260808 14:59:38.197597 5471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:38.196650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:59689)
0808 14:59:38.197155 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:38.197349 (+ 194us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":249,"threads_started":1}
I20260808 14:59:38.660966 5472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:38.659779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:38931)
0808 14:59:38.660469 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:38.660623 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":343,"threads_started":1}
I20260808 14:59:38.736938 5473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:38.736284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:52957)
0808 14:59:38.736696 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:38.736775 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":225,"threads_started":1}
I20260808 14:59:39.199120 5474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:39.198410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:37085)
0808 14:59:39.198874 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:39.198955 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":227,"threads_started":1}
I20260808 14:59:39.662747 5479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:39.662039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:45081)
0808 14:59:39.662501 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:39.662580 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":231,"threads_started":1}
I20260808 14:59:39.738637 5481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:39.737904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:51801)
0808 14:59:39.738375 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:39.738463 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":244,"threads_started":1}
I20260808 14:59:40.200716 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:40.199996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:36953)
0808 14:59:40.200452 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:40.200535 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":249,"threads_started":1}
I20260808 14:59:40.664911 5495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:40.663788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:51357)
0808 14:59:40.664466 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:40.664595 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":338,"threads_started":1}
I20260808 14:59:40.740295 5496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:40.739613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:50503)
0808 14:59:40.740049 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:40.740128 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":224,"threads_started":1}
I20260808 14:59:41.202491 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:41.201659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:40261)
0808 14:59:41.202209 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:41.202290 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":319,"threads_started":1}
I20260808 14:59:41.666517 5499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:41.665802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:35533)
0808 14:59:41.666230 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:41.666313 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":208,"threads_started":1}
I20260808 14:59:41.742009 5501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:41.741225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:54251)
0808 14:59:41.741742 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:41.741821 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":287,"threads_started":1}
I20260808 14:59:42.204105 5502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:42.203357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:43373)
0808 14:59:42.203842 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:42.203928 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":248,"threads_started":1}
I20260808 14:59:42.668143 5503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:42.667447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:49183)
0808 14:59:42.667894 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:42.667975 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":226,"threads_started":1}
I20260808 14:59:42.743655 5506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:42.742978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:37903)
0808 14:59:42.743422 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:42.743501 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":223,"threads_started":1}
I20260808 14:59:43.206025 5508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:43.205191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:52261)
0808 14:59:43.205764 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:43.205858 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":294,"threads_started":1}
I20260808 14:59:43.670028 5510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:43.669300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:44561)
0808 14:59:43.669734 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:43.669864 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":224,"threads_started":1}
I20260808 14:59:43.745381 5512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:43.744532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:43041)
0808 14:59:43.745019 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:43.745101 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":230,"threads_started":1}
I20260808 14:59:44.207664 5514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:44.206900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:50047)
0808 14:59:44.207372 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:44.207452 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":213,"threads_started":1}
I20260808 14:59:44.671908 5516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:44.671030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:53149)
0808 14:59:44.671615 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:44.671696 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":291,"threads_started":1}
I20260808 14:59:44.746929 5518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:44.746235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:49615)
0808 14:59:44.746662 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:44.746742 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":239,"threads_started":1}
I20260808 14:59:45.209575 5521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:45.208622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:43977)
0808 14:59:45.209131 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:45.209399 (+ 268us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":253,"threads_started":1}
I20260808 14:59:45.673620 5524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:45.672853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:56597)
0808 14:59:45.673341 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:45.673424 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":230,"threads_started":1}
I20260808 14:59:45.748519 5525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:45.747789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:54295)
0808 14:59:45.748243 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:45.748345 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":236,"threads_started":1}
I20260808 14:59:46.211253 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:46.210453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:40635)
0808 14:59:46.210947 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:46.211035 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":236,"threads_started":1}
I20260808 14:59:46.675212 5527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:46.674509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:60351)
0808 14:59:46.674960 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:46.675041 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":221,"threads_started":1}
I20260808 14:59:46.750164 5528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:46.749489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:59491)
0808 14:59:46.749916 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:46.749996 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":227,"threads_started":1}
I20260808 14:59:47.213411 5530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:47.212315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:48273)
0808 14:59:47.212997 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:47.213121 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":387,"threads_started":1}
I20260808 14:59:47.676888 5531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:47.676092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:59571)
0808 14:59:47.676648 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:47.676731 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":346,"threads_started":1}
I20260808 14:59:47.751926 5532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:47.751110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:58489)
0808 14:59:47.751617 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:47.751722 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":316,"threads_started":1}
I20260808 14:59:48.215054 5534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:48.214321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:46099)
0808 14:59:48.214773 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:48.214872 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":228,"threads_started":1}
I20260808 14:59:48.678612 5536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:48.677876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:39131)
0808 14:59:48.678323 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:48.678434 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":227,"threads_started":1}
I20260808 14:59:48.753728 5538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:48.752958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:39431)
0808 14:59:48.753484 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:48.753567 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":318,"threads_started":1}
I20260808 14:59:49.216709 5539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:49.215986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:33379)
0808 14:59:49.216453 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:49.216548 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":247,"threads_started":1}
I20260808 14:59:49.680236 5541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:49.679505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:47853)
0808 14:59:49.680008 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:49.680088 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":293,"threads_started":1}
I20260808 14:59:49.755384 5543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:49.754620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:58767)
0808 14:59:49.755081 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:49.755182 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":244,"threads_started":1}
I20260808 14:59:50.218582 5544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:50.217750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:40313)
0808 14:59:50.218278 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:50.218386 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":269,"threads_started":1}
I20260808 14:59:50.681967 5545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:50.681081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:40685)
0808 14:59:50.681677 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:50.681766 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":345,"threads_started":1}
I20260808 14:59:50.757634 5546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:50.756297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:56477)
0808 14:59:50.757342 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:50.757437 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":942,"thread_start_us":657,"threads_started":1}
I20260808 14:59:51.220196 5547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:51.219480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:40749)
0808 14:59:51.219910 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:51.220001 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":225,"threads_started":1}
I20260808 14:59:51.683586 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:51.682822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:35729)
0808 14:59:51.683298 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:51.683398 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":241,"threads_started":1}
I20260808 14:59:51.759439 5550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:51.758714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.129:43167)
0808 14:59:51.759148 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:51.759260 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":219,"threads_started":1}
I20260808 14:59:52.222085 5552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:52.221331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.130:35577)
0808 14:59:52.221777 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:52.221902 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":219,"threads_started":1}
I20260808 14:59:52.659461 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 4753
I20260808 14:59:52.680882 5553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:52.660666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46414 (local address 127.12.73.129:38443)
0808 14:59:52.661848 (+ 1182us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:52.661870 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:52.661921 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:59:52.664772 (+ 2851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:52.664788 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:52.665392 (+ 604us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:52.665779 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:52.667583 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:52.669689 (+ 2106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:52.671276 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:52.671942 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:52.672082 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:52.674714 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:52.674722 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:52.674736 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:52.674778 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:52.677950 (+ 3172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:52.678546 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:52.678557 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:52.678563 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:52.678732 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:52.679114 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:52.679118 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:52.679121 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:52.679670 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:52.679907 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:52.680258 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 14:59:52.680579 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":967,"thread_start_us":302,"threads_started":1}
I20260808 14:59:52.682299 5025 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:52.685771 5556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:52.684715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36059 (local address 127.12.73.131:46107)
0808 14:59:52.685284 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:52.685472 (+ 188us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":247,"threads_started":1}
I20260808 14:59:52.769402 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 4753
I20260808 14:59:52.799230 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 5038
I20260808 14:59:52.816895 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:52.800300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53730 (local address 127.12.73.130:39807)
0808 14:59:52.800857 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:52.800871 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:52.800909 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:59:52.802548 (+ 1639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:52.802558 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:52.802968 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:52.803250 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:52.804631 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:52.806025 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:52.807299 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:52.807944 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:52.808078 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:52.810828 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:52.810835 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:52.810849 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:52.810890 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:52.814018 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:52.814638 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:52.814644 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:52.814650 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:52.814810 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:52.815141 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:52.815144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:52.815146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:52.815620 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:52.815854 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:52.816188 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 14:59:52.816600 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":275,"threads_started":1}
I20260808 14:59:52.818292 5245 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:52.904299 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 5038
I20260808 14:59:52.930262 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 5260
I20260808 14:59:52.949023 5564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:52.931316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44526 (local address 127.12.73.131:34431)
0808 14:59:52.931936 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:52.931950 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:52.931991 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:59:52.933721 (+ 1730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:52.933731 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:52.934138 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:52.934496 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:52.936048 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:52.937359 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:52.938677 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:52.939315 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:52.939521 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:52.942270 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:52.942277 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:52.942292 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:52.942333 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:52.945454 (+ 3121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:52.946225 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:52.946233 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:52.946238 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:52.946436 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:52.946853 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:52.946858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:52.946861 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:52.947440 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:52.947798 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:52.948293 (+ 495us) server_negotiation.cc:299] Negotiation successful
0808 14:59:52.948710 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":274,"threads_started":1}
I20260808 14:59:52.950450 5455 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:53.033761 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 5260
2026-08-08T14:59:53Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24686 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:59:53 dist-test-slave-z8x9 krb5kdc[5571](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:59:53 dist-test-slave-z8x9 krb5kdc[5571](info): set up 2 sockets
Aug 08 14:59:53 dist-test-slave-z8x9 krb5kdc[5571](info): commencing operation
krb5kdc: starting...
W20260808 14:59:54.386229 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.002s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 14:59:54 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:59:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:59:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 14:59:54.678072 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36799
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:36799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:55.028401 5588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:55.028757 5588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:55.028931 5588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:55.036113 5588 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:59:55.036245 5588 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:59:55.036337 5588 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:59:55.036439 5588 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:59:55.036552 5588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:55.036656 5588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:55.036738 5588 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:59:55.036818 5588 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:59:55.046442 5588 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:36799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:55.047694 5588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:55.049007 5588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:55.061240 5598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:55.061444 5596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:55.061661 5601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:55.062069 5588 server_base.cc:1034] running on GCE node
I20260808 14:59:55.062863 5588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:55.064224 5588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:55.065475 5588 hybrid_clock.cc:648] HybridClock initialized: now 1786201195065417 us; error 35 us; skew 500 ppm
I20260808 14:59:55.065811 5588 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:55 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201195, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:55.069105 5588 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 14:59:55.070573 5588 webserver.cc:460] Webserver started at http://127.12.73.190:44631/ using document root <none> and password file <none>
I20260808 14:59:55.071220 5588 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:55.071307 5588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:55.071578 5588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:59:55.074560 5588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "e7f33276b9144274978c2b14065f6b26"
format_stamp: "Formatted at 2026-08-08 14:59:55 on dist-test-slave-z8x9"
server_key: "f92c0e714c717ea9b67a51f8ce20bcc6"
server_key_iv: "924874cb609da75d481678822a5385bd"
server_key_version: "encryptionkey@0"
I20260808 14:59:55.075275 5588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "e7f33276b9144274978c2b14065f6b26"
format_stamp: "Formatted at 2026-08-08 14:59:55 on dist-test-slave-z8x9"
server_key: "f92c0e714c717ea9b67a51f8ce20bcc6"
server_key_iv: "924874cb609da75d481678822a5385bd"
server_key_version: "encryptionkey@0"
I20260808 14:59:55.080329 5588 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 14:59:55.083777 5609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:55.085047 5588 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:59:55.085238 5588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "e7f33276b9144274978c2b14065f6b26"
format_stamp: "Formatted at 2026-08-08 14:59:55 on dist-test-slave-z8x9"
server_key: "f92c0e714c717ea9b67a51f8ce20bcc6"
server_key_iv: "924874cb609da75d481678822a5385bd"
server_key_version: "encryptionkey@0"
I20260808 14:59:55.085465 5588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:55.108970 5588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:55.113456 5588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:55.113759 5588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:55.132714 5588 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:36799
I20260808 14:59:55.132735 5706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:36799 every 8 connection(s)
I20260808 14:59:55.134047 5588 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 14:59:55.137753 5708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:55.138088 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 5588
I20260808 14:59:55.138314 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 14:59:55.138993 12582 external_mini_cluster.cc:1428] Setting key d306245b665b54839c507bd2e40a96ec
I20260808 14:59:55.153070 5708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Bootstrap starting.
I20260808 14:59:55.156729 5708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:55.158015 5708 log.cc:824] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:59:55 dist-test-slave-z8x9 krb5kdc[5571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:55.161640 5708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: No bootstrap required, opened a new log
I20260808 14:59:55.168361 5713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:55.141074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51818 (local address 127.12.73.190:36799)
0808 14:59:55.142035 (+ 961us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:55.142050 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:55.142123 (+ 73us) server_negotiation.cc:407] Connection header received
0808 14:59:55.145388 (+ 3265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:55.145417 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:55.145898 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:55.146340 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:55.149239 (+ 2899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:55.151296 (+ 2057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:55.153340 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:55.154350 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:55.154534 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:55.159547 (+ 5013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:55.159561 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:55.159585 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:55.159630 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:55.163730 (+ 4100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:55.164432 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:55.164440 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:55.164448 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:55.164659 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:55.165007 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:55.165013 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:55.165016 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:55.165730 (+ 714us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:55.166070 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:55.166489 (+ 419us) server_negotiation.cc:299] Negotiation successful
0808 14:59:55.166939 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":418,"threads_started":1}
I20260808 14:59:55.172056 5708 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } }
I20260808 14:59:55.172406 5708 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:55.172484 5708 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f33276b9144274978c2b14065f6b26, State: Initialized, Role: FOLLOWER
I20260808 14:59:55.173002 5708 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } }
I20260808 14:59:55.173273 5708 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:59:55.173435 5708 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:59:55.173607 5708 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:55.176144 5708 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } }
I20260808 14:59:55.176590 5708 leader_election.cc:302] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7f33276b9144274978c2b14065f6b26; no voters:
I20260808 14:59:55.177114 5708 leader_election.cc:288] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:59:55.177347 5716 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:59:55.178045 5716 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 1 LEADER]: Becoming Leader. State: Replica: e7f33276b9144274978c2b14065f6b26, State: Running, Role: LEADER
I20260808 14:59:55.178603 5716 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } }
I20260808 14:59:55.179260 5708 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:59:55.181551 5717 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7f33276b9144274978c2b14065f6b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } } }
I20260808 14:59:55.182047 5717 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:55.181939 5722 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7f33276b9144274978c2b14065f6b26. Latest consensus state: current_term: 1 leader_uuid: "e7f33276b9144274978c2b14065f6b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } } }
I20260808 14:59:55.182289 5722 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: This master's current role is: LEADER
I20260808 14:59:55.184440 5730 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:59:55.188588 5730 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:59:55.196897 5730 catalog_manager.cc:1347] Generated new cluster ID: b727265ee6724199b7435d29909cc072
I20260808 14:59:55.197013 5730 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:59:55.220888 5730 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:59:55.222277 5730 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:59:55.229130 5730 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Generated new TSK 0
I20260808 14:59:55.230146 5730 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 14:59:55.303637 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36799
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:55.643841 5755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:55.644105 5755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:55.644228 5755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:55.651180 5755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:55.651280 5755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:55.651419 5755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 14:59:55.661332 5755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:55.662572 5755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:55.663902 5755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:55.677260 5762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:55.677294 5767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:55.677330 5763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:55.677980 5755 server_base.cc:1034] running on GCE node
I20260808 14:59:55.678561 5755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:55.679522 5755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:55.680724 5755 hybrid_clock.cc:648] HybridClock initialized: now 1786201195680661 us; error 49 us; skew 500 ppm
I20260808 14:59:55.681068 5755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:55 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201195, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:55.684540 5755 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 14:59:55.685902 5755 webserver.cc:460] Webserver started at http://127.12.73.129:40149/ using document root <none> and password file <none>
I20260808 14:59:55.686524 5755 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:55.686623 5755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:55.686893 5755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:59:55.689925 5755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "8a5a5bf3febd49418a51ae53fcc19f89"
format_stamp: "Formatted at 2026-08-08 14:59:55 on dist-test-slave-z8x9"
server_key: "423d572840559fc2116eb864adbc04db"
server_key_iv: "381b67a88c5017b5735669264ba30453"
server_key_version: "encryptionkey@0"
I20260808 14:59:55.690614 5755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "8a5a5bf3febd49418a51ae53fcc19f89"
format_stamp: "Formatted at 2026-08-08 14:59:55 on dist-test-slave-z8x9"
server_key: "423d572840559fc2116eb864adbc04db"
server_key_iv: "381b67a88c5017b5735669264ba30453"
server_key_version: "encryptionkey@0"
I20260808 14:59:55.695458 5755 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 14:59:55.698817 5778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:55.700044 5755 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:59:55.700220 5755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "8a5a5bf3febd49418a51ae53fcc19f89"
format_stamp: "Formatted at 2026-08-08 14:59:55 on dist-test-slave-z8x9"
server_key: "423d572840559fc2116eb864adbc04db"
server_key_iv: "381b67a88c5017b5735669264ba30453"
server_key_version: "encryptionkey@0"
I20260808 14:59:55.700444 5755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:55.711670 5755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:55.715422 5755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:55.715731 5755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:55.716632 5755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:55.717971 5755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:55.718045 5755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:55.718217 5755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:55.718302 5755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:55.752022 5755 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:40929
I20260808 14:59:55.752074 5977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:40929 every 8 connection(s)
I20260808 14:59:55.753393 5755 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 14:59:55.754984 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 5755
I20260808 14:59:55.755263 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 14:59:55.755928 12582 external_mini_cluster.cc:1428] Setting key 68177d026a7fb5e83b44924e87962ef1
Aug 08 14:59:55 dist-test-slave-z8x9 krb5kdc[5571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201195, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:55.774020 5983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:55.756298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:34945 (local address 127.12.73.190:36799)
0808 14:59:55.756980 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:55.756988 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:55.757774 (+ 786us) server_negotiation.cc:407] Connection header received
0808 14:59:55.759629 (+ 1855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:55.759634 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:55.759713 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:55.759850 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:55.761420 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:55.762154 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:55.763743 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:55.764159 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:55.764298 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:55.767764 (+ 3466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:55.767769 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:55.767773 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:55.767803 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:55.770642 (+ 2839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:55.771399 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:55.771408 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:55.771414 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:55.771564 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:55.772028 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:55.772035 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:55.772042 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:55.772405 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:55.772561 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:55.773267 (+ 706us) server_negotiation.cc:299] Negotiation successful
0808 14:59:55.773532 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":453,"threads_started":1}
I20260808 14:59:55.774641 5984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:55.756790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:34945)
0808 14:59:55.757622 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:55.757659 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:55.759371 (+ 1712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:55.760103 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:55.760111 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:55.760655 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:55.761255 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:55.761274 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:55.762316 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:55.762322 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:55.763594 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:55.763606 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:55.764419 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:55.764427 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:55.764647 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:55.765410 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:55.765431 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:55.767556 (+ 2125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:55.770786 (+ 3230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:55.770793 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:55.770803 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:55.771257 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:55.771706 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:55.771709 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:55.771712 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:55.771902 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:55.772529 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:55.772534 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:55.772856 (+ 322us) client_negotiation.cc:769] Sending connection context
0808 14:59:55.773074 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 14:59:55.773540 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":372,"threads_started":1}
I20260808 14:59:55.776144 5978 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36799
I20260808 14:59:55.776467 5978 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:55.777221 5978 heartbeater.cc:511] Master 127.12.73.190:36799 requested a full tablet report, sending...
I20260808 14:59:55.779452 5650 ts_manager.cc:194] Registered new tserver with Master: 8a5a5bf3febd49418a51ae53fcc19f89 (127.12.73.129:40929)
I20260808 14:59:55.781075 5650 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:34945
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 14:59:55.824127 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36799
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:56.162992 5988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:56.163262 5988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:56.163429 5988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:56.170761 5988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:56.170907 5988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:56.171111 5988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 14:59:56.181092 5988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:56.182512 5988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:56.183804 5988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:56.197024 6007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:56.196992 6003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:56.196988 6002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:56.198182 5988 server_base.cc:1034] running on GCE node
I20260808 14:59:56.198850 5988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:56.199858 5988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:56.201090 5988 hybrid_clock.cc:648] HybridClock initialized: now 1786201196201053 us; error 57 us; skew 500 ppm
I20260808 14:59:56.201433 5988 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:56 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201196, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:56.204789 5988 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 14:59:56.206302 5988 webserver.cc:460] Webserver started at http://127.12.73.130:43805/ using document root <none> and password file <none>
I20260808 14:59:56.206982 5988 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:56.207131 5988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:56.207450 5988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:59:56.210372 5988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "c93ab3e4ac574be387af68e3dac81f7a"
format_stamp: "Formatted at 2026-08-08 14:59:56 on dist-test-slave-z8x9"
server_key: "9606d766c5af7fe07efb1a33d23539d7"
server_key_iv: "6edf2afca690c586a2f46990b9e9f859"
server_key_version: "encryptionkey@0"
I20260808 14:59:56.211181 5988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "c93ab3e4ac574be387af68e3dac81f7a"
format_stamp: "Formatted at 2026-08-08 14:59:56 on dist-test-slave-z8x9"
server_key: "9606d766c5af7fe07efb1a33d23539d7"
server_key_iv: "6edf2afca690c586a2f46990b9e9f859"
server_key_version: "encryptionkey@0"
I20260808 14:59:56.216126 5988 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 14:59:56.219712 6017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:56.221062 5988 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 14:59:56.221318 5988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "c93ab3e4ac574be387af68e3dac81f7a"
format_stamp: "Formatted at 2026-08-08 14:59:56 on dist-test-slave-z8x9"
server_key: "9606d766c5af7fe07efb1a33d23539d7"
server_key_iv: "6edf2afca690c586a2f46990b9e9f859"
server_key_version: "encryptionkey@0"
I20260808 14:59:56.221525 5988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:56.248788 5988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:56.253019 5988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:56.253381 5988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:56.254380 5988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:56.255787 5988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:56.255892 5988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:56.256049 5988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:56.256125 5988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:56.291373 5988 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:43959
I20260808 14:59:56.291462 6196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:43959 every 8 connection(s)
I20260808 14:59:56.292665 5988 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 14:59:56.302600 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 5988
I20260808 14:59:56.302809 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 14:59:56.303262 12582 external_mini_cluster.cc:1428] Setting key bc2cfd4cef8555ca54d13019f81f13fd
Aug 08 14:59:56 dist-test-slave-z8x9 krb5kdc[5571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201196, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:56.313274 6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.295421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:54233 (local address 127.12.73.190:36799)
0808 14:59:56.295899 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:56.295904 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:56.296839 (+ 935us) server_negotiation.cc:407] Connection header received
0808 14:59:56.298809 (+ 1970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:56.298815 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:56.298906 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:56.299026 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:56.300596 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.301404 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.303073 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.303561 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.303769 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:56.307421 (+ 3652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:56.307426 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:56.307429 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:56.307460 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:56.310179 (+ 2719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:56.310942 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:56.310949 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:56.310953 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:56.311097 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:56.311542 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:56.311550 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:56.311553 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:56.311823 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:56.311979 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:56.312605 (+ 626us) server_negotiation.cc:299] Negotiation successful
0808 14:59:56.312851 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":243,"threads_started":1}
I20260808 14:59:56.314183 6207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.295962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:54233)
0808 14:59:56.296672 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:56.296721 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:56.298525 (+ 1804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:56.299326 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:56.299338 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:56.299892 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:56.300421 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.300438 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.301569 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.301573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:56.302918 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.302938 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.303856 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.303865 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:56.304104 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:56.304905 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:56.304934 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:56.307200 (+ 2266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:56.310326 (+ 3126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:56.310334 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:56.310365 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:56.310802 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:56.311225 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:56.311230 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:56.311234 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:56.311423 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:56.311956 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:56.311963 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:56.312266 (+ 303us) client_negotiation.cc:769] Sending connection context
0808 14:59:56.312527 (+ 261us) client_negotiation.cc:240] Negotiation successful
0808 14:59:56.313046 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":273,"threads_started":1}
I20260808 14:59:56.315724 6197 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36799
I20260808 14:59:56.316071 6197 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:56.316781 6197 heartbeater.cc:511] Master 127.12.73.190:36799 requested a full tablet report, sending...
I20260808 14:59:56.318264 5650 ts_manager.cc:194] Registered new tserver with Master: c93ab3e4ac574be387af68e3dac81f7a (127.12.73.130:43959)
I20260808 14:59:56.319073 5650 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:54233
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 14:59:56.368065 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36799
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:59:56.703276 6216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:59:56.703562 6216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:59:56.703776 6216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:59:56.711011 6216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:59:56.711114 6216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:59:56.711328 6216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 14:59:56.720765 6216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:59:56.722057 6216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:59:56.723368 6216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:59:56.736527 6223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:56.736563 6224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:59:56.736683 6227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:59:56.737691 6216 server_base.cc:1034] running on GCE node
I20260808 14:59:56.738298 6216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:59:56.739180 6216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:59:56.740417 6216 hybrid_clock.cc:648] HybridClock initialized: now 1786201196740367 us; error 63 us; skew 500 ppm
I20260808 14:59:56.740720 6216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:59:56 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201196, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:59:56.743848 6216 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 14:59:56.745133 6216 webserver.cc:460] Webserver started at http://127.12.73.131:36521/ using document root <none> and password file <none>
I20260808 14:59:56.745800 6216 fs_manager.cc:359] Metadata directory not provided
I20260808 14:59:56.745905 6216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:59:56.746145 6216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:59:56.748862 6216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "1e6e030aff824110b161ff3160c79077"
format_stamp: "Formatted at 2026-08-08 14:59:56 on dist-test-slave-z8x9"
server_key: "006394a072fc1e93c42e8318e0e594a4"
server_key_iv: "d883165376974c0cbcd0859c2b3b08d5"
server_key_version: "encryptionkey@0"
I20260808 14:59:56.749619 6216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "1e6e030aff824110b161ff3160c79077"
format_stamp: "Formatted at 2026-08-08 14:59:56 on dist-test-slave-z8x9"
server_key: "006394a072fc1e93c42e8318e0e594a4"
server_key_iv: "d883165376974c0cbcd0859c2b3b08d5"
server_key_version: "encryptionkey@0"
I20260808 14:59:56.755609 6216 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 14:59:56.759536 6239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:56.760783 6216 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 14:59:56.760960 6216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "1e6e030aff824110b161ff3160c79077"
format_stamp: "Formatted at 2026-08-08 14:59:56 on dist-test-slave-z8x9"
server_key: "006394a072fc1e93c42e8318e0e594a4"
server_key_iv: "d883165376974c0cbcd0859c2b3b08d5"
server_key_version: "encryptionkey@0"
I20260808 14:59:56.761145 6216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:59:56.785005 5978 heartbeater.cc:503] Master 127.12.73.190:36799 was elected leader, sending a full tablet report...
I20260808 14:59:56.797941 6216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:59:56.802183 6216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:59:56.802495 6216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:59:56.803503 6216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:59:56.804826 6216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:59:56.804904 6216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:56.805074 6216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:59:56.805162 6216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:59:56.839354 6216 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:41559
I20260808 14:59:56.839413 6427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:41559 every 8 connection(s)
I20260808 14:59:56.840687 6216 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 14:59:56.845088 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 6216
I20260808 14:59:56.845302 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 14:59:56.845762 12582 external_mini_cluster.cc:1428] Setting key 2a49be8a58d634b9ee04a932cacfbe8e
Aug 08 14:59:56 dist-test-slave-z8x9 krb5kdc[5571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201196, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 14:59:56.861595 6433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.843199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:38073 (local address 127.12.73.190:36799)
0808 14:59:56.843642 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:56.843647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:56.844678 (+ 1031us) server_negotiation.cc:407] Connection header received
0808 14:59:56.846701 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:56.846707 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:56.846805 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:56.846926 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:56.848441 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.849287 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.850817 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.851239 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.851378 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:56.854812 (+ 3434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:56.854819 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:56.854830 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:56.854865 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:56.857554 (+ 2689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:56.858476 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:56.858482 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:56.858501 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:56.858660 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:56.859276 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:56.859281 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:56.859284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:56.859690 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:56.859864 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:56.860836 (+ 972us) server_negotiation.cc:299] Negotiation successful
0808 14:59:56.861221 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":202,"threads_started":1}
I20260808 14:59:56.862591 6434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.843753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:38073)
0808 14:59:56.844501 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:56.844538 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:56.846427 (+ 1889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:56.847178 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:56.847186 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:56.847707 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:59:56.848270 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.848289 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.849445 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.849449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:56.850664 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.850677 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.851486 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.851494 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:56.851733 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:56.852362 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:59:56.852390 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:59:56.854597 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:59:56.857702 (+ 3105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:56.857711 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:56.857726 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:56.858324 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:56.858805 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:59:56.858810 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:59:56.858815 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:59:56.859091 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:59:56.859826 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:59:56.859834 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:59:56.860260 (+ 426us) client_negotiation.cc:769] Sending connection context
0808 14:59:56.860635 (+ 375us) client_negotiation.cc:240] Negotiation successful
0808 14:59:56.861242 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":323,"threads_started":1}
I20260808 14:59:56.863984 6431 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36799
I20260808 14:59:56.864301 6431 heartbeater.cc:464] Registering TS with master...
I20260808 14:59:56.865108 6431 heartbeater.cc:511] Master 127.12.73.190:36799 requested a full tablet report, sending...
I20260808 14:59:56.866613 5650 ts_manager.cc:194] Registered new tserver with Master: 1e6e030aff824110b161ff3160c79077 (127.12.73.131:41559)
I20260808 14:59:56.867413 5650 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:38073
I20260808 14:59:56.873785 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:59:56.891254 6433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.878451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51828 (local address 127.12.73.190:36799)
0808 14:59:56.878615 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:56.878620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:56.879214 (+ 594us) server_negotiation.cc:407] Connection header received
0808 14:59:56.879358 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:56.879361 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:56.879422 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:56.879505 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:56.881051 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.881840 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.883239 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.883620 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.883728 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:56.886223 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:56.886229 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:56.886232 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:56.886260 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:56.888764 (+ 2504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:56.889485 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:56.889489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:56.889491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:56.889607 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:56.890039 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:56.890042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:56.890044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:56.890420 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:56.890604 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:56.890868 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 14:59:56.891028 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:59:56.895227 5650 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51828:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:59:56.902491 5650 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:59:56.937316 6451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.914889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47492 (local address 127.12.73.129:40929)
0808 14:59:56.928753 (+ 13864us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:56.928761 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:56.928791 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:59:56.928887 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:56.928896 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:56.929114 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:56.929752 (+ 638us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:56.930545 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.932114 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.934474 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.936021 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.936173 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:56.936413 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:56.936710 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 14:59:56.936895 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13690,"thread_start_us":13519,"threads_started":1}
I20260808 14:59:56.937340 6453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.914560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:40929 (local address 127.0.0.1:47492)
0808 14:59:56.926087 (+ 11527us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:56.926135 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:56.926324 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:56.929470 (+ 3146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:56.929481 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:56.929514 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:56.930330 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.930341 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.932281 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.932292 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:56.934298 (+ 2006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.934311 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.936232 (+ 1921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.936239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:56.936453 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:56.936511 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 14:59:56.936640 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 14:59:56.936831 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11199,"mutex_wait_us":55,"thread_start_us":12687,"threads_started":1}
I20260808 14:59:56.938494 6446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.914927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:43959 (local address 127.0.0.1:34854)
0808 14:59:56.927585 (+ 12658us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:56.927610 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:56.927762 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:56.929020 (+ 1258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:56.929031 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:56.929076 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:56.930133 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.930150 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.932024 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.932032 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:56.934447 (+ 2415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.934462 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.937634 (+ 3172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.937641 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:56.937810 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:56.937853 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:59:56.937929 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 14:59:56.938054 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12492,"mutex_wait_us":2,"thread_start_us":11575,"threads_started":1}
I20260808 14:59:56.939143 6457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.929362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:41559 (local address 127.0.0.1:44770)
0808 14:59:56.931361 (+ 1999us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:56.931378 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:56.931562 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:56.932261 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:56.932266 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:56.932295 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:56.932957 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.932971 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.934838 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.934845 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:56.936091 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.936130 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.938359 (+ 2229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.938367 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:56.938567 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:56.938603 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 14:59:56.938693 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:59:56.938807 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1865,"mutex_wait_us":3,"thread_start_us":2644,"threads_started":1}
I20260808 14:59:56.939226 6450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.914930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34854 (local address 127.12.73.130:43959)
0808 14:59:56.928304 (+ 13374us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:56.928317 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:56.928351 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:59:56.928461 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:56.928468 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:56.928752 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:56.928963 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:56.930308 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.931881 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.934617 (+ 2736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.936026 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.936183 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:56.936397 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:56.938729 (+ 2332us) server_negotiation.cc:299] Negotiation successful
0808 14:59:56.938918 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13218,"thread_start_us":13117,"threads_started":1}
I20260808 14:59:56.939774 6456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.928176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44770 (local address 127.12.73.131:41559)
0808 14:59:56.930607 (+ 2431us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:56.930617 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:56.931468 (+ 851us) server_negotiation.cc:407] Connection header received
0808 14:59:56.931732 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:56.931739 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:56.931952 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:56.932108 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:56.933164 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.934702 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.936299 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.937823 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.937931 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:56.938154 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:56.939379 (+ 1225us) server_negotiation.cc:299] Negotiation successful
0808 14:59:56.939513 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2210,"thread_start_us":2445,"threads_started":1}
I20260808 14:59:56.941826 5866 tablet_service.cc:1467] Processing CreateTablet for tablet 17185acecdd64906aa289b9406fd124a (DEFAULT_TABLE table=test-table [id=6074bd68c6ad4ccd990fbdc6a72115e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:59:56.942098 6104 tablet_service.cc:1467] Processing CreateTablet for tablet 17185acecdd64906aa289b9406fd124a (DEFAULT_TABLE table=test-table [id=6074bd68c6ad4ccd990fbdc6a72115e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:59:56.943207 5866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17185acecdd64906aa289b9406fd124a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:56.943442 6104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17185acecdd64906aa289b9406fd124a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:56.945966 6305 tablet_service.cc:1467] Processing CreateTablet for tablet 17185acecdd64906aa289b9406fd124a (DEFAULT_TABLE table=test-table [id=6074bd68c6ad4ccd990fbdc6a72115e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:59:56.947404 6305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17185acecdd64906aa289b9406fd124a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:59:56.954581 6458 tablet_bootstrap.cc:492] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a: Bootstrap starting.
I20260808 14:59:56.957535 6458 tablet_bootstrap.cc:654] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:56.958804 6458 log.cc:824] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:56.958871 6459 tablet_bootstrap.cc:492] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89: Bootstrap starting.
I20260808 14:59:56.961684 6463 tablet_bootstrap.cc:492] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077: Bootstrap starting.
I20260808 14:59:56.963305 6459 tablet_bootstrap.cc:654] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:56.964983 6459 log.cc:824] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:56.965144 6463 tablet_bootstrap.cc:654] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077: Neither blocks nor log segments found. Creating new log.
I20260808 14:59:56.966369 6463 log.cc:824] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077: Log is configured to *not* fsync() on all Append() calls
I20260808 14:59:56.967514 6458 tablet_bootstrap.cc:492] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a: No bootstrap required, opened a new log
I20260808 14:59:56.967849 6458 ts_tablet_manager.cc:1397] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.011s
I20260808 14:59:56.968724 6459 tablet_bootstrap.cc:492] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89: No bootstrap required, opened a new log
I20260808 14:59:56.968993 6459 ts_tablet_manager.cc:1397] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 14:59:56.969470 6463 tablet_bootstrap.cc:492] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077: No bootstrap required, opened a new log
I20260808 14:59:56.969724 6463 ts_tablet_manager.cc:1397] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20260808 14:59:56.976393 6459 raft_consensus.cc:348] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } }
I20260808 14:59:56.976928 6459 raft_consensus.cc:374] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:56.977069 6459 raft_consensus.cc:729] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a5a5bf3febd49418a51ae53fcc19f89, State: Initialized, Role: FOLLOWER
I20260808 14:59:56.977916 6459 consensus_queue.cc:260] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } }
I20260808 14:59:56.978814 6458 raft_consensus.cc:348] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } }
I20260808 14:59:56.979300 6458 raft_consensus.cc:374] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:56.979498 6458 raft_consensus.cc:729] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c93ab3e4ac574be387af68e3dac81f7a, State: Initialized, Role: FOLLOWER
I20260808 14:59:56.979883 6459 ts_tablet_manager.cc:1428] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260808 14:59:56.980253 6458 consensus_queue.cc:260] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } }
I20260808 14:59:56.980315 6463 raft_consensus.cc:348] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } }
I20260808 14:59:56.980697 6463 raft_consensus.cc:374] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:59:56.980825 6463 raft_consensus.cc:729] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6e030aff824110b161ff3160c79077, State: Initialized, Role: FOLLOWER
I20260808 14:59:56.981582 6463 consensus_queue.cc:260] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } }
I20260808 14:59:56.982895 6431 heartbeater.cc:503] Master 127.12.73.190:36799 was elected leader, sending a full tablet report...
I20260808 14:59:56.983644 6463 ts_tablet_manager.cc:1428] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077: Time spent starting tablet: real 0.014s user 0.007s sys 0.006s
I20260808 14:59:56.984759 6197 heartbeater.cc:503] Master 127.12.73.190:36799 was elected leader, sending a full tablet report...
I20260808 14:59:56.985445 6458 ts_tablet_manager.cc:1428] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a: Time spent starting tablet: real 0.017s user 0.010s sys 0.008s
I20260808 14:59:56.992354 6471 raft_consensus.cc:482] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:59:56.992628 6471 raft_consensus.cc:504] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } }
I20260808 14:59:56.994488 6471 leader_election.cc:288] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a5a5bf3febd49418a51ae53fcc19f89 (127.12.73.129:40929), 1e6e030aff824110b161ff3160c79077 (127.12.73.131:41559)
I20260808 14:59:57.001363 6451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.994955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:43183 (local address 127.12.73.129:40929)
0808 14:59:56.995141 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:56.995145 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:56.995650 (+ 505us) server_negotiation.cc:407] Connection header received
0808 14:59:56.995996 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:56.996002 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:56.996080 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:56.996153 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:56.996821 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.997635 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.999461 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:57.000228 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:57.000410 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:57.000490 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:57.000930 (+ 440us) server_negotiation.cc:299] Negotiation successful
0808 14:59:57.001055 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:59:57.001497 6456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.995729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:50771 (local address 127.12.73.131:41559)
0808 14:59:56.995940 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:56.995947 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:56.996329 (+ 382us) server_negotiation.cc:407] Connection header received
0808 14:59:56.996596 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:56.996601 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:56.996666 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:56.996764 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:59:56.997345 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.998023 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.999732 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:57.000498 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:57.000701 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:57.000779 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:57.001078 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 14:59:57.001242 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:59:57.001510 6476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.994817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:40929 (local address 127.12.73.130:43183)
0808 14:59:56.995549 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:56.995569 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:56.995775 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:56.996329 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:56.996333 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:56.996361 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:56.996682 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.996689 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.997760 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.997767 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:56.999296 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.999308 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:57.000459 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:57.000465 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:57.000669 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:57.000712 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:59:57.000892 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 14:59:57.001024 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":40,"thread_start_us":370,"threads_started":1}
I20260808 14:59:57.001682 6477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:56.995634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:41559 (local address 127.12.73.130:50771)
0808 14:59:56.996224 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0808 14:59:56.996239 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:59:56.996454 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:59:56.996783 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:59:56.996787 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:59:56.996812 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:59:56.997148 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.997156 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:56.998171 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:56.998176 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:56.999562 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:59:56.999575 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:59:57.000748 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:59:57.000754 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:59:57.000917 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:57.000946 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 14:59:57.001051 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 14:59:57.001177 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":1,"spinlock_wait_cycles":25728,"thread_start_us":319,"threads_started":1}
I20260808 14:59:57.002825 6339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17185acecdd64906aa289b9406fd124a" candidate_uuid: "c93ab3e4ac574be387af68e3dac81f7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6e030aff824110b161ff3160c79077" is_pre_election: true
I20260808 14:59:57.002830 5900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17185acecdd64906aa289b9406fd124a" candidate_uuid: "c93ab3e4ac574be387af68e3dac81f7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" is_pre_election: true
I20260808 14:59:57.003413 5900 raft_consensus.cc:2454] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c93ab3e4ac574be387af68e3dac81f7a in term 0.
I20260808 14:59:57.003413 6339 raft_consensus.cc:2454] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c93ab3e4ac574be387af68e3dac81f7a in term 0.
I20260808 14:59:57.004101 6020 leader_election.cc:302] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a5a5bf3febd49418a51ae53fcc19f89, c93ab3e4ac574be387af68e3dac81f7a; no voters:
I20260808 14:59:57.004447 6471 raft_consensus.cc:2781] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:59:57.004604 6471 raft_consensus.cc:482] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:59:57.004750 6471 raft_consensus.cc:3037] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Advancing to term 1
W20260808 14:59:57.005910 5981 tablet.cc:2369] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:59:57.007187 6471 raft_consensus.cc:504] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } }
I20260808 14:59:57.007766 6471 leader_election.cc:288] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [CANDIDATE]: Term 1 election: Requested vote from peers 8a5a5bf3febd49418a51ae53fcc19f89 (127.12.73.129:40929), 1e6e030aff824110b161ff3160c79077 (127.12.73.131:41559)
I20260808 14:59:57.008216 5900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17185acecdd64906aa289b9406fd124a" candidate_uuid: "c93ab3e4ac574be387af68e3dac81f7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a5a5bf3febd49418a51ae53fcc19f89"
I20260808 14:59:57.008304 6339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17185acecdd64906aa289b9406fd124a" candidate_uuid: "c93ab3e4ac574be387af68e3dac81f7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6e030aff824110b161ff3160c79077"
I20260808 14:59:57.008440 5900 raft_consensus.cc:3037] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:57.008488 6339 raft_consensus.cc:3037] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:59:57.011721 5900 raft_consensus.cc:2454] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c93ab3e4ac574be387af68e3dac81f7a in term 1.
I20260808 14:59:57.011727 6339 raft_consensus.cc:2454] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c93ab3e4ac574be387af68e3dac81f7a in term 1.
I20260808 14:59:57.012111 6020 leader_election.cc:302] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a5a5bf3febd49418a51ae53fcc19f89, c93ab3e4ac574be387af68e3dac81f7a; no voters:
I20260808 14:59:57.012427 6471 raft_consensus.cc:2781] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:59:57.012975 6471 raft_consensus.cc:686] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 1 LEADER]: Becoming Leader. State: Replica: c93ab3e4ac574be387af68e3dac81f7a, State: Running, Role: LEADER
I20260808 14:59:57.013585 6471 consensus_queue.cc:237] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } }
I20260808 14:59:57.017959 5650 catalog_manager.cc:5495] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a reported cstate change: term changed from 0 to 1, leader changed from <none> to c93ab3e4ac574be387af68e3dac81f7a (127.12.73.130). New cstate: current_term: 1 leader_uuid: "c93ab3e4ac574be387af68e3dac81f7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } health_report { overall_health: UNKNOWN } } }
W20260808 14:59:57.044904 6198 tablet.cc:2369] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:59:57.049889 6450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:57.044330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34860 (local address 127.12.73.130:43959)
0808 14:59:57.044546 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:57.044553 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:57.044574 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:59:57.044811 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:57.044814 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:57.044902 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:57.045064 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:59:57.045488 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:57.046219 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:57.047670 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:57.048100 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:57.048241 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:57.048740 (+ 499us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:59:57.049272 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:59:57.049435 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:57.049537 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 14:59:57.049617 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:59:57.057778 5900 raft_consensus.cc:1261] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89 [term 1 FOLLOWER]: Refusing update from remote peer c93ab3e4ac574be387af68e3dac81f7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:59:57.057775 6339 raft_consensus.cc:1261] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077 [term 1 FOLLOWER]: Refusing update from remote peer c93ab3e4ac574be387af68e3dac81f7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:59:57.058774 6478 consensus_queue.cc:1035] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:59:57.059122 6471 consensus_queue.cc:1035] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:59:57.071992 6493 mvcc.cc:205] Tried to move back new op lower bound from 7316280103138267136 to 7316280102971744256. Current Snapshot: MvccSnapshot[applied={T|T < 7316280103138267136}]
I20260808 14:59:57.087913 5650 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:59:57.088163 5650 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:59:57.091912 5650 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Sending DeleteTablet for 3 replicas of tablet 17185acecdd64906aa289b9406fd124a
I20260808 14:59:57.093060 5866 tablet_service.cc:1514] Processing DeleteTablet for tablet 17185acecdd64906aa289b9406fd124a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:59:57 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:47492
I20260808 14:59:57.094018 6504 tablet_replica.cc:330] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89: stopping tablet replica
I20260808 14:59:57.094225 6104 tablet_service.cc:1514] Processing DeleteTablet for tablet 17185acecdd64906aa289b9406fd124a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:59:57 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:34854
I20260808 14:59:57.094367 6305 tablet_service.cc:1514] Processing DeleteTablet for tablet 17185acecdd64906aa289b9406fd124a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:59:57 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:44770
I20260808 14:59:57.094534 6504 raft_consensus.cc:2229] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:59:57.095026 6504 raft_consensus.cc:2258] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:59:57.095276 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 5755
I20260808 14:59:57.105820 6504 ts_tablet_manager.cc:1905] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:57.106563 6506 tablet_replica.cc:330] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a: stopping tablet replica
I20260808 14:59:57.107016 6506 raft_consensus.cc:2229] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:59:57.107724 6506 raft_consensus.cc:2258] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:59:57.110075 6506 ts_tablet_manager.cc:1905] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:57.112601 6508 tablet_replica.cc:330] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077: stopping tablet replica
I20260808 14:59:57.117633 6506 ts_tablet_manager.cc:1918] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:59:57.117898 6506 log.cc:1196] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/17185acecdd64906aa289b9406fd124a
I20260808 14:59:57.118589 6506 ts_tablet_manager.cc:1939] T 17185acecdd64906aa289b9406fd124a P c93ab3e4ac574be387af68e3dac81f7a: Deleting consensus metadata
I20260808 14:59:57.119827 6504 ts_tablet_manager.cc:1918] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:59:57.120556 6508 raft_consensus.cc:2229] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:59:57.121013 5617 catalog_manager.cc:4841] TS c93ab3e4ac574be387af68e3dac81f7a (127.12.73.130:43959): tablet 17185acecdd64906aa289b9406fd124a (table test-table [id=6074bd68c6ad4ccd990fbdc6a72115e7]) successfully deleted
I20260808 14:59:57.122131 6508 raft_consensus.cc:2258] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:59:57.123522 6504 log.cc:1196] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/17185acecdd64906aa289b9406fd124a
I20260808 14:59:57.125072 6508 ts_tablet_manager.cc:1905] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:59:57.129804 6504 ts_tablet_manager.cc:1939] T 17185acecdd64906aa289b9406fd124a P 8a5a5bf3febd49418a51ae53fcc19f89: Deleting consensus metadata
I20260808 14:59:57.131568 6508 ts_tablet_manager.cc:1918] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:59:57.131794 6508 log.cc:1196] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/17185acecdd64906aa289b9406fd124a
I20260808 14:59:57.132599 5613 catalog_manager.cc:4841] TS 8a5a5bf3febd49418a51ae53fcc19f89 (127.12.73.129:40929): tablet 17185acecdd64906aa289b9406fd124a (table test-table [id=6074bd68c6ad4ccd990fbdc6a72115e7]) successfully deleted
I20260808 14:59:57.132977 6508 ts_tablet_manager.cc:1939] T 17185acecdd64906aa289b9406fd124a P 1e6e030aff824110b161ff3160c79077: Deleting consensus metadata
Aug 08 14:59:57 dist-test-slave-z8x9 krb5kdc[5571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 14:59:57.134572 5613 catalog_manager.cc:4841] TS 1e6e030aff824110b161ff3160c79077 (127.12.73.131:41559): tablet 17185acecdd64906aa289b9406fd124a (table test-table [id=6074bd68c6ad4ccd990fbdc6a72115e7]) successfully deleted
I20260808 14:59:57.142603 6451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:57.096444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47496 (local address 127.12.73.129:40929)
0808 14:59:57.096667 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:57.096676 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:57.123122 (+ 26446us) server_negotiation.cc:407] Connection header received
0808 14:59:57.123356 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:57.123362 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:57.123457 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:57.123574 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:57.125870 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:57.127032 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:57.129028 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:57.129775 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:57.129911 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:57.135501 (+ 5590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:57.135515 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:57.135534 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:57.135574 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:57.139301 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:57.140206 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:57.140215 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:57.140219 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:57.140380 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:57.140872 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:57.140878 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:57.140881 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:57.141323 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:57.141616 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:57.142011 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 14:59:57.142229 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:59:57.143290 5970 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:57.236613 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 5755
I20260808 14:59:57.274253 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 5988
Aug 08 14:59:57 dist-test-slave-z8x9 krb5kdc[5571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 14:59:57.293556 6450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:57.275074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34870 (local address 127.12.73.130:43959)
0808 14:59:57.275302 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:57.275310 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:57.275431 (+ 121us) server_negotiation.cc:407] Connection header received
0808 14:59:57.275634 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:57.275638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:57.275718 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:57.275803 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:57.277775 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:57.278603 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:57.280536 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:57.280952 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:57.281048 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:57.286674 (+ 5626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:57.286690 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:57.286706 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:57.286747 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:57.290073 (+ 3326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:57.291043 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:57.291051 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:57.291054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:57.291233 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:57.291712 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:57.291717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:57.291720 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:57.292176 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:57.292524 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:57.292893 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 14:59:57.293145 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 14:59:57.294373 6191 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:57.410682 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 5988
I20260808 14:59:57.434073 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 6216
Aug 08 14:59:57 dist-test-slave-z8x9 krb5kdc[5571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 14:59:57.453908 6456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:59:57.434912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44784 (local address 127.12.73.131:41559)
0808 14:59:57.435096 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 14:59:57.435103 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:59:57.435147 (+ 44us) server_negotiation.cc:407] Connection header received
0808 14:59:57.435403 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:59:57.435408 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:59:57.435474 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:59:57.435594 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:59:57.436972 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:57.437780 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:57.439512 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:59:57.440068 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:59:57.440205 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:59:57.448090 (+ 7885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:59:57.448106 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:59:57.448123 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:59:57.448160 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:59:57.450916 (+ 2756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:57.451711 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:57.451719 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:57.451722 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:57.451855 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:59:57.452272 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:59:57.452277 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:59:57.452281 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:59:57.452658 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:59:57.452963 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0808 14:59:57.453310 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 14:59:57.453553 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:59:57.454569 6419 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:57.544189 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 6216
I20260808 14:59:57.570246 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 5588
I20260808 14:59:57.571449 5698 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:59:57.683951 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 5588
I20260808 15:00:17.713984 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36799
--webserver_interface=127.12.73.190
--webserver_port=44631
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:36799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:00:18.065462 6516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:00:18.065747 6516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:00:18.065918 6516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:00:18.073242 6516 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 15:00:18.073339 6516 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 15:00:18.073412 6516 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 15:00:18.073513 6516 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:00:18.073603 6516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:00:18.073725 6516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:00:18.073803 6516 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:00:18.073896 6516 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:00:18.084064 6516 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:36799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=44631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:00:18.085431 6516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:00:18.086777 6516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:00:18.113584 6524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:18.113618 6523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:18.113662 6526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:00:18.113931 6516 server_base.cc:1034] running on GCE node
I20260808 15:00:18.115134 6516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:00:18.116695 6516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:00:18.117933 6516 hybrid_clock.cc:648] HybridClock initialized: now 1786201218117802 us; error 97 us; skew 500 ppm
I20260808 15:00:18.118346 6516 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:00:18 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201218, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:00:18.124969 6516 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:00:18.126704 6516 webserver.cc:460] Webserver started at http://127.12.73.190:44631/ using document root <none> and password file <none>
I20260808 15:00:18.127483 6516 fs_manager.cc:359] Metadata directory not provided
I20260808 15:00:18.127636 6516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:00:18.133606 6516 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 15:00:18.136576 6539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:18.138026 6516 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:00:18.138211 6516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "e7f33276b9144274978c2b14065f6b26"
format_stamp: "Formatted at 2026-08-08 14:59:55 on dist-test-slave-z8x9"
server_key: "f92c0e714c717ea9b67a51f8ce20bcc6"
server_key_iv: "924874cb609da75d481678822a5385bd"
server_key_version: "encryptionkey@0"
I20260808 15:00:18.139272 6516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:00:18.153824 6516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:00:18.158550 6516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:00:18.158877 6516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:00:18.178500 6516 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:36799
I20260808 15:00:18.178524 6634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:36799 every 8 connection(s)
I20260808 15:00:18.180094 6516 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:00:18.187186 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 6516
I20260808 15:00:18.187680 6639 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:00:18.188279 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:40929
--local_ip_for_outbound_sockets=127.12.73.129
--tserver_master_addrs=127.12.73.190:36799
--webserver_port=40149
--webserver_interface=127.12.73.129
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:00:18.192940 6639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Bootstrap starting.
I20260808 15:00:18.215529 6639 log.cc:824] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Log is configured to *not* fsync() on all Append() calls
I20260808 15:00:18.227717 6639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:00:18.228291 6639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Bootstrap complete.
I20260808 15:00:18.237948 6639 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } }
I20260808 15:00:18.238854 6639 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f33276b9144274978c2b14065f6b26, State: Initialized, Role: FOLLOWER
I20260808 15:00:18.239470 6639 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } }
I20260808 15:00:18.239733 6639 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:00:18.239881 6639 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:00:18.240057 6639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 1 FOLLOWER]: Advancing to term 2
I20260808 15:00:18.244402 6639 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } }
I20260808 15:00:18.244927 6639 leader_election.cc:302] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7f33276b9144274978c2b14065f6b26; no voters:
I20260808 15:00:18.245645 6639 leader_election.cc:288] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 15:00:18.245790 6644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 15:00:18.247236 6644 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 2 LEADER]: Becoming Leader. State: Replica: e7f33276b9144274978c2b14065f6b26, State: Running, Role: LEADER
I20260808 15:00:18.247907 6644 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } }
I20260808 15:00:18.248150 6639 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:00:18.251242 6645 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e7f33276b9144274978c2b14065f6b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } } }
I20260808 15:00:18.252136 6645 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: This master's current role is: LEADER
I20260808 15:00:18.251863 6649 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7f33276b9144274978c2b14065f6b26. Latest consensus state: current_term: 2 leader_uuid: "e7f33276b9144274978c2b14065f6b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } } }
I20260808 15:00:18.252274 6649 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: This master's current role is: LEADER
I20260808 15:00:18.253134 6661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:00:18.276254 6661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:00:18.278390 6661 catalog_manager.cc:1259] Loaded cluster ID: b727265ee6724199b7435d29909cc072
I20260808 15:00:18.278628 6661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:00:18.284368 6661 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:00:18.286530 6661 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Loaded TSK: 0
I20260808 15:00:18.299114 6674 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 15:00:18.324824 6661 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Generated new TSK 1
I20260808 15:00:18.325273 6661 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 15:00:18.574278 6642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:00:18.574612 6642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:00:18.574782 6642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:00:18.582473 6642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:00:18.582630 6642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:00:18.582801 6642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 15:00:18.592555 6642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:40929
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=40149
--tserver_master_addrs=127.12.73.190:36799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:00:18.593946 6642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:00:18.595244 6642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:00:18.610222 6681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:18.610280 6688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:18.610915 6691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:00:18.614600 6642 server_base.cc:1034] running on GCE node
I20260808 15:00:18.615207 6642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:00:18.616222 6642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:00:18.617436 6642 hybrid_clock.cc:648] HybridClock initialized: now 1786201218617378 us; error 51 us; skew 500 ppm
I20260808 15:00:18.617750 6642 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:00:18 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201218, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:00:18.620925 6642 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 15:00:18.622597 6642 webserver.cc:460] Webserver started at http://127.12.73.129:40149/ using document root <none> and password file <none>
I20260808 15:00:18.623281 6642 fs_manager.cc:359] Metadata directory not provided
I20260808 15:00:18.623440 6642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:00:18.628644 6642 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.002s
I20260808 15:00:18.631376 6700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:18.632718 6642 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:00:18.632894 6642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "8a5a5bf3febd49418a51ae53fcc19f89"
format_stamp: "Formatted at 2026-08-08 14:59:55 on dist-test-slave-z8x9"
server_key: "423d572840559fc2116eb864adbc04db"
server_key_iv: "381b67a88c5017b5735669264ba30453"
server_key_version: "encryptionkey@0"
I20260808 15:00:18.633893 6642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:00:18.657981 6642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:00:18.663628 6642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:00:18.664001 6642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:00:18.665316 6642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:00:18.667196 6642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:00:18.667292 6642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:18.667429 6642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:00:18.667508 6642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:18.701713 6642 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:40929
I20260808 15:00:18.701809 6903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:40929 every 8 connection(s)
I20260808 15:00:18.703166 6642 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 15:00:18.711810 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 6642
I20260808 15:00:18.712586 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:43959
--local_ip_for_outbound_sockets=127.12.73.130
--tserver_master_addrs=127.12.73.190:36799
--webserver_port=43805
--webserver_interface=127.12.73.130
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:00:18 dist-test-slave-z8x9 krb5kdc[5571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201218, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:00:18.728577 6914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:18.706506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:33371)
0808 15:00:18.707503 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:18.707539 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 15:00:18.709325 (+ 1786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:00:18.710648 (+ 1323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:00:18.710661 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:00:18.711439 (+ 778us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:00:18.712217 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:18.712246 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:18.713992 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:18.714000 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:18.716102 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:18.716119 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:18.717268 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:18.717279 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:18.717603 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:18.718349 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:00:18.718381 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:00:18.720981 (+ 2600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:00:18.724353 (+ 3372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:00:18.724361 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:00:18.724374 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:00:18.725014 (+ 640us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:00:18.725529 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:00:18.725535 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:00:18.725538 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:00:18.725803 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:00:18.726715 (+ 912us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:00:18.726721 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:00:18.726991 (+ 270us) client_negotiation.cc:769] Sending connection context
0808 15:00:18.727208 (+ 217us) client_negotiation.cc:240] Negotiation successful
0808 15:00:18.727635 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":775,"thread_start_us":584,"threads_started":1}
I20260808 15:00:18.729151 6913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:18.706377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:33371 (local address 127.12.73.190:36799)
0808 15:00:18.707015 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:18.707027 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:18.707671 (+ 644us) server_negotiation.cc:407] Connection header received
0808 15:00:18.709837 (+ 2166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:18.709849 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:18.710146 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:18.710502 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:00:18.712435 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:18.713815 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:18.716325 (+ 2510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:18.716944 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:18.717209 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:18.721286 (+ 4077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:00:18.721294 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:00:18.721308 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:00:18.721344 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:00:18.724198 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:18.725215 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:18.725228 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:18.725241 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:18.725409 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:18.725926 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:18.725930 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:18.725932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:18.726553 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:00:18.726749 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:18.727451 (+ 702us) server_negotiation.cc:299] Negotiation successful
0808 15:00:18.727901 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":291,"threads_started":1}
I20260808 15:00:18.731859 6910 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36799
I20260808 15:00:18.732162 6910 heartbeater.cc:464] Registering TS with master...
I20260808 15:00:18.732836 6910 heartbeater.cc:511] Master 127.12.73.190:36799 requested a full tablet report, sending...
I20260808 15:00:18.735294 6573 ts_manager.cc:194] Registered new tserver with Master: 8a5a5bf3febd49418a51ae53fcc19f89 (127.12.73.129:40929)
I20260808 15:00:18.737494 6573 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:33371
W20260808 15:00:19.058773 6916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:00:19.059217 6916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:00:19.059378 6916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:00:19.066864 6916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:00:19.067010 6916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:00:19.067191 6916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 15:00:19.077216 6916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:43959
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=43805
--tserver_master_addrs=127.12.73.190:36799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:00:19.078563 6916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:00:19.079903 6916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:00:19.093590 6923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:19.093641 6927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:19.093541 6925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:00:19.094386 6916 server_base.cc:1034] running on GCE node
I20260808 15:00:19.095062 6916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:00:19.096048 6916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:00:19.097314 6916 hybrid_clock.cc:648] HybridClock initialized: now 1786201219097284 us; error 75 us; skew 500 ppm
I20260808 15:00:19.097667 6916 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:00:19 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201219, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:00:19.100939 6916 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 15:00:19.102545 6916 webserver.cc:460] Webserver started at http://127.12.73.130:43805/ using document root <none> and password file <none>
I20260808 15:00:19.103255 6916 fs_manager.cc:359] Metadata directory not provided
I20260808 15:00:19.103421 6916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:00:19.108983 6916 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 15:00:19.111748 6943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:19.113054 6916 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:00:19.113298 6916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "c93ab3e4ac574be387af68e3dac81f7a"
format_stamp: "Formatted at 2026-08-08 14:59:56 on dist-test-slave-z8x9"
server_key: "9606d766c5af7fe07efb1a33d23539d7"
server_key_iv: "6edf2afca690c586a2f46990b9e9f859"
server_key_version: "encryptionkey@0"
I20260808 15:00:19.114293 6916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:00:19.130551 6916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:00:19.134889 6916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:00:19.135206 6916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:00:19.136219 6916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:00:19.137717 6916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:00:19.137842 6916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:19.137974 6916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:00:19.138096 6916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 15:00:19.172225 6916 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:43959
I20260808 15:00:19.172271 7130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:43959 every 8 connection(s)
I20260808 15:00:19.173751 6916 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 15:00:19.177572 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 6916
I20260808 15:00:19.178472 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:41559
--local_ip_for_outbound_sockets=127.12.73.131
--tserver_master_addrs=127.12.73.190:36799
--webserver_port=36521
--webserver_interface=127.12.73.131
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 15:00:19 dist-test-slave-z8x9 krb5kdc[5571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201219, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:00:19.200735 6913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.176547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:51011 (local address 127.12.73.190:36799)
0808 15:00:19.176729 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:19.176733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:19.178230 (+ 1497us) server_negotiation.cc:407] Connection header received
0808 15:00:19.181141 (+ 2911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:19.181148 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:19.181285 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:19.181397 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:00:19.183480 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.184790 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.187427 (+ 2637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.188161 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.188301 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.193310 (+ 5009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:00:19.193319 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:00:19.193325 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:00:19.193371 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:00:19.197274 (+ 3903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:19.198006 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:19.198014 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:19.198020 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:19.198201 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:19.198639 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:19.198647 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:19.198654 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:19.199044 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:00:19.199207 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:19.199989 (+ 782us) server_negotiation.cc:299] Negotiation successful
0808 15:00:19.200297 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 15:00:19.201364 7134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.177015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:51011)
0808 15:00:19.178034 (+ 1019us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:19.178092 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 15:00:19.180822 (+ 2730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:00:19.181645 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:00:19.181657 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:00:19.182484 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:00:19.183272 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.183299 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.185023 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.185031 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.187251 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.187270 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.188469 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.188479 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.188818 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.189768 (+ 950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:00:19.189803 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:00:19.192989 (+ 3186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:00:19.197419 (+ 4430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:00:19.197426 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:00:19.197439 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:00:19.197865 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:00:19.198322 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:00:19.198325 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:00:19.198328 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:00:19.198513 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:00:19.199240 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:00:19.199247 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:00:19.199557 (+ 310us) client_negotiation.cc:769] Sending connection context
0808 15:00:19.199795 (+ 238us) client_negotiation.cc:240] Negotiation successful
0808 15:00:19.200193 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":428,"threads_started":1}
I20260808 15:00:19.202963 7131 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36799
I20260808 15:00:19.203361 7131 heartbeater.cc:464] Registering TS with master...
I20260808 15:00:19.204236 7131 heartbeater.cc:511] Master 127.12.73.190:36799 requested a full tablet report, sending...
I20260808 15:00:19.205922 6573 ts_manager.cc:194] Registered new tserver with Master: c93ab3e4ac574be387af68e3dac81f7a (127.12.73.130:43959)
I20260808 15:00:19.206761 6573 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:51011
W20260808 15:00:19.529492 7136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:00:19.529848 7136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:00:19.530027 7136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:00:19.537582 7136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:00:19.537755 7136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:00:19.537935 7136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 15:00:19.548228 7136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:41559
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=36521
--tserver_master_addrs=127.12.73.190:36799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:00:19.549697 7136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:00:19.551059 7136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:00:19.564671 7147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:19.564814 7146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:19.564781 7149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:00:19.566298 7136 server_base.cc:1034] running on GCE node
I20260808 15:00:19.566984 7136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:00:19.567942 7136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:00:19.569147 7136 hybrid_clock.cc:648] HybridClock initialized: now 1786201219569103 us; error 34 us; skew 500 ppm
I20260808 15:00:19.569535 7136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:00:19 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201219, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:00:19.572757 7136 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 15:00:19.575794 7136 webserver.cc:460] Webserver started at http://127.12.73.131:36521/ using document root <none> and password file <none>
I20260808 15:00:19.576822 7136 fs_manager.cc:359] Metadata directory not provided
I20260808 15:00:19.576994 7136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:00:19.583088 7136 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:00:19.585886 7164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:19.587242 7136 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:00:19.587422 7136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "1e6e030aff824110b161ff3160c79077"
format_stamp: "Formatted at 2026-08-08 14:59:56 on dist-test-slave-z8x9"
server_key: "006394a072fc1e93c42e8318e0e594a4"
server_key_iv: "d883165376974c0cbcd0859c2b3b08d5"
server_key_version: "encryptionkey@0"
I20260808 15:00:19.588403 7136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:00:19.606436 7136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:00:19.610646 7136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:00:19.610934 7136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:00:19.611944 7136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:00:19.613356 7136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:00:19.613481 7136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:19.613612 7136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:00:19.613700 7136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:19.648684 7136 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:41559
I20260808 15:00:19.648736 7362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:41559 every 8 connection(s)
I20260808 15:00:19.650262 7136 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 15:00:19.655575 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 7136
Aug 08 15:00:19 dist-test-slave-z8x9 krb5kdc[5571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201219, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:00:19.673491 7369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.656532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35208 (local address 127.12.73.190:36799)
0808 15:00:19.657067 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:19.657076 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:19.657539 (+ 463us) server_negotiation.cc:407] Connection header received
0808 15:00:19.657742 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:19.657747 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:19.657803 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:19.657920 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:00:19.659945 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.661078 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.663012 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.663646 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.663785 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.667372 (+ 3587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:00:19.667376 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:00:19.667379 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:00:19.667418 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:00:19.670553 (+ 3135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:19.671355 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:19.671359 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:19.671361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:19.671519 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:19.671934 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:19.671937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:19.671939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:19.672239 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:00:19.672528 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:19.672829 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 15:00:19.673067 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":325,"threads_started":1}
I20260808 15:00:19.674721 7368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.653260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:36163)
0808 15:00:19.654047 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:19.654094 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 15:00:19.656222 (+ 2128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:00:19.657400 (+ 1178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:00:19.657409 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:00:19.657930 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:00:19.658485 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.658503 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.659999 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.660007 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.661740 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.661752 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.662728 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.662733 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.662934 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.663678 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:00:19.663713 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:00:19.666609 (+ 2896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:00:19.670657 (+ 4048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:00:19.670667 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:00:19.670685 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:00:19.671124 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:00:19.671557 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:00:19.671565 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:00:19.671570 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:00:19.671782 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:00:19.672373 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:00:19.672382 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:00:19.672816 (+ 434us) client_negotiation.cc:769] Sending connection context
0808 15:00:19.673122 (+ 306us) client_negotiation.cc:240] Negotiation successful
0808 15:00:19.673696 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":302,"threads_started":1}
I20260808 15:00:19.675752 6913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.652757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:36163 (local address 127.12.73.190:36799)
0808 15:00:19.652974 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:19.652981 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:19.654214 (+ 1233us) server_negotiation.cc:407] Connection header received
0808 15:00:19.656525 (+ 2311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:19.656531 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:19.656613 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:19.656720 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:00:19.658664 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.659816 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.661886 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.662525 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.662664 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.666840 (+ 4176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:00:19.666848 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:00:19.666853 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:00:19.666897 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:00:19.670513 (+ 3616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:19.671267 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:19.671275 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:19.671280 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:19.671430 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:19.671913 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:19.671918 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:19.671921 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:19.672231 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:00:19.672405 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:19.675286 (+ 2881us) server_negotiation.cc:299] Negotiation successful
0808 15:00:19.675488 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 15:00:19.677008 7363 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36799
I20260808 15:00:19.677397 7363 heartbeater.cc:464] Registering TS with master...
I20260808 15:00:19.678171 7363 heartbeater.cc:511] Master 127.12.73.190:36799 requested a full tablet report, sending...
I20260808 15:00:19.679545 6570 ts_manager.cc:194] Registered new tserver with Master: 1e6e030aff824110b161ff3160c79077 (127.12.73.131:41559)
I20260808 15:00:19.680469 6570 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:36163
I20260808 15:00:19.688946 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:00:19.695849 6913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.689923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35216 (local address 127.12.73.190:36799)
0808 15:00:19.690117 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:19.690125 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:19.690638 (+ 513us) server_negotiation.cc:407] Connection header received
0808 15:00:19.690832 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:19.690836 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:19.690963 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:19.691083 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:00:19.691527 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.692356 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.694058 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.694476 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.694567 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.695091 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:00:19.695376 (+ 285us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 15:00:19.695641 (+ 265us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35216: token expired
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 15:00:19.695984 6913 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35216: token expired
W20260808 15:00:19.696584 6439 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.12.73.190:36799)
I20260808 15:00:19.710417 6913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.697022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35228 (local address 127.12.73.190:36799)
0808 15:00:19.697228 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:19.697236 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:19.697304 (+ 68us) server_negotiation.cc:407] Connection header received
0808 15:00:19.697411 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:19.697415 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:19.697486 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:19.697563 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:00:19.698873 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.699597 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.701011 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.701629 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.701757 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.704782 (+ 3025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:00:19.704789 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:00:19.704794 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:00:19.704833 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:00:19.707886 (+ 3053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:19.708534 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:19.708538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:19.708540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:19.708659 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:19.708990 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:19.708994 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:19.708995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:19.709387 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:00:19.709587 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:19.709914 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 15:00:19.710081 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:00:19.713800 6570 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35228:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:00:19.721145 6570 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:00:19.740649 6910 heartbeater.cc:503] Master 127.12.73.190:36799 was elected leader, sending a full tablet report...
I20260808 15:00:19.747751 7379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.732725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:41559 (local address 127.0.0.1:54862)
0808 15:00:19.733658 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:19.733711 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 15:00:19.733897 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:00:19.736097 (+ 2200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:00:19.736108 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:00:19.736158 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:00:19.736755 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.736774 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.740396 (+ 3622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.740405 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.743640 (+ 3235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.743663 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.746633 (+ 2970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.746642 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.746877 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.746960 (+ 83us) client_negotiation.cc:769] Sending connection context
0808 15:00:19.747100 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 15:00:19.747309 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":536,"threads_started":1}
I20260808 15:00:19.749351 7382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.733080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54862 (local address 127.12.73.131:41559)
0808 15:00:19.735301 (+ 2221us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:19.735312 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:19.735353 (+ 41us) server_negotiation.cc:407] Connection header received
0808 15:00:19.735474 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:19.735485 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:19.735802 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:19.737059 (+ 1257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:00:19.737676 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.740169 (+ 2493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.744330 (+ 4161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.746354 (+ 2024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.748008 (+ 1654us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.748672 (+ 664us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:19.748764 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 15:00:19.748949 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2024,"thread_start_us":1798,"threads_started":1}
I20260808 15:00:19.753302 7255 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed8eab803434be7998912946cdf356d (DEFAULT_TABLE table=test-table [id=455f3839e5da4db48b1ce79c866d9cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:00:19.755252 7381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.732882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:43959 (local address 127.0.0.1:49084)
0808 15:00:19.746627 (+ 13745us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:19.746647 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 15:00:19.746779 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:00:19.747768 (+ 989us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:00:19.747773 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:00:19.747794 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:00:19.748219 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.748233 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.750284 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.750291 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.752289 (+ 1998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.752301 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.753880 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.753889 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.754442 (+ 553us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.754577 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 15:00:19.754672 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 15:00:19.754806 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13579,"mutex_wait_us":321,"thread_start_us":13414,"threads_started":1}
I20260808 15:00:19.755301 7384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.733631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49084 (local address 127.12.73.130:43959)
0808 15:00:19.734618 (+ 987us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:19.734627 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:19.746797 (+ 12170us) server_negotiation.cc:407] Connection header received
0808 15:00:19.746947 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:19.746959 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:19.747257 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:19.747479 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:00:19.748416 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.750150 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.752451 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.753473 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.753633 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.753851 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:19.754756 (+ 905us) server_negotiation.cc:299] Negotiation successful
0808 15:00:19.754936 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":830,"thread_start_us":1079,"threads_started":1}
I20260808 15:00:19.755409 7255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed8eab803434be7998912946cdf356d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:00:19.756999 7385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.734166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:40929 (local address 127.0.0.1:36098)
0808 15:00:19.747390 (+ 13224us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:19.747408 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:00:19.747604 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:00:19.748814 (+ 1210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:00:19.748818 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:00:19.748843 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:00:19.749354 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.749369 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.752016 (+ 2647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.752020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.754209 (+ 2189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.754223 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.756202 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.756209 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.756383 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.756414 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 15:00:19.756507 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 15:00:19.756635 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13109,"mutex_wait_us":67,"thread_start_us":12844,"threads_started":1}
I20260808 15:00:19.757136 7386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.734540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36098 (local address 127.12.73.129:40929)
0808 15:00:19.745910 (+ 11370us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:19.745918 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:19.747507 (+ 1589us) server_negotiation.cc:407] Connection header received
0808 15:00:19.747797 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:19.747805 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:19.748307 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:19.748526 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:00:19.749594 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.751858 (+ 2264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.754390 (+ 2532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.755953 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.756103 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.756313 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:19.756606 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 15:00:19.756775 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11185,"thread_start_us":11376,"threads_started":1}
I20260808 15:00:19.759518 7021 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed8eab803434be7998912946cdf356d (DEFAULT_TABLE table=test-table [id=455f3839e5da4db48b1ce79c866d9cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:00:19.760982 7021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed8eab803434be7998912946cdf356d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:00:19.760756 6794 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed8eab803434be7998912946cdf356d (DEFAULT_TABLE table=test-table [id=455f3839e5da4db48b1ce79c866d9cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:00:19.762290 6794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed8eab803434be7998912946cdf356d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:00:19.769233 7390 tablet_bootstrap.cc:492] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077: Bootstrap starting.
I20260808 15:00:19.773824 7390 tablet_bootstrap.cc:654] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077: Neither blocks nor log segments found. Creating new log.
I20260808 15:00:19.775130 7390 log.cc:824] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077: Log is configured to *not* fsync() on all Append() calls
I20260808 15:00:19.776628 7395 tablet_bootstrap.cc:492] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89: Bootstrap starting.
I20260808 15:00:19.778285 7396 tablet_bootstrap.cc:492] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a: Bootstrap starting.
I20260808 15:00:19.778961 7390 tablet_bootstrap.cc:492] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077: No bootstrap required, opened a new log
I20260808 15:00:19.779253 7390 ts_tablet_manager.cc:1397] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260808 15:00:19.781814 7396 tablet_bootstrap.cc:654] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a: Neither blocks nor log segments found. Creating new log.
I20260808 15:00:19.781937 7395 tablet_bootstrap.cc:654] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89: Neither blocks nor log segments found. Creating new log.
I20260808 15:00:19.782903 7396 log.cc:824] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a: Log is configured to *not* fsync() on all Append() calls
I20260808 15:00:19.783166 7395 log.cc:824] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89: Log is configured to *not* fsync() on all Append() calls
I20260808 15:00:19.785928 7395 tablet_bootstrap.cc:492] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89: No bootstrap required, opened a new log
I20260808 15:00:19.786123 7396 tablet_bootstrap.cc:492] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a: No bootstrap required, opened a new log
I20260808 15:00:19.786243 7395 ts_tablet_manager.cc:1397] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 15:00:19.786379 7396 ts_tablet_manager.cc:1397] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 15:00:19.790011 7390 raft_consensus.cc:348] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } }
I20260808 15:00:19.790504 7390 raft_consensus.cc:374] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:00:19.790606 7390 raft_consensus.cc:729] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6e030aff824110b161ff3160c79077, State: Initialized, Role: FOLLOWER
I20260808 15:00:19.791389 7390 consensus_queue.cc:260] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } }
I20260808 15:00:19.792625 7363 heartbeater.cc:503] Master 127.12.73.190:36799 was elected leader, sending a full tablet report...
I20260808 15:00:19.794957 7390 ts_tablet_manager.cc:1428] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077: Time spent starting tablet: real 0.016s user 0.013s sys 0.000s
I20260808 15:00:19.795213 7395 raft_consensus.cc:348] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } }
I20260808 15:00:19.795720 7395 raft_consensus.cc:374] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:00:19.795845 7395 raft_consensus.cc:729] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a5a5bf3febd49418a51ae53fcc19f89, State: Initialized, Role: FOLLOWER
I20260808 15:00:19.796492 7395 consensus_queue.cc:260] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } }
I20260808 15:00:19.796717 7396 raft_consensus.cc:348] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } }
I20260808 15:00:19.797204 7396 raft_consensus.cc:374] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:00:19.797338 7396 raft_consensus.cc:729] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c93ab3e4ac574be387af68e3dac81f7a, State: Initialized, Role: FOLLOWER
I20260808 15:00:19.797936 7396 consensus_queue.cc:260] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } }
I20260808 15:00:19.798621 7395 ts_tablet_manager.cc:1428] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89: Time spent starting tablet: real 0.012s user 0.005s sys 0.008s
I20260808 15:00:19.799983 7131 heartbeater.cc:503] Master 127.12.73.190:36799 was elected leader, sending a full tablet report...
I20260808 15:00:19.800586 7396 ts_tablet_manager.cc:1428] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
W20260808 15:00:19.901968 7366 tablet.cc:2369] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:00:19.925868 7133 tablet.cc:2369] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:00:19.926115 7403 raft_consensus.cc:482] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:00:19.926481 7403 raft_consensus.cc:504] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } }
I20260808 15:00:19.928251 7403 leader_election.cc:288] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c93ab3e4ac574be387af68e3dac81f7a (127.12.73.130:43959), 8a5a5bf3febd49418a51ae53fcc19f89 (127.12.73.129:40929)
I20260808 15:00:19.934826 7368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.928645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:43959 (local address 127.12.73.131:51925)
0808 15:00:19.929054 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:19.929077 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 15:00:19.929245 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:00:19.929605 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:00:19.929609 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:00:19.929642 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:00:19.929871 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.929884 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.931374 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.931380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.932889 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.932901 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.934068 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.934073 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.934265 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.934289 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:00:19.934394 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 15:00:19.934536 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246}
I20260808 15:00:19.934821 7384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.928978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:51925 (local address 127.12.73.130:43959)
0808 15:00:19.929206 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:19.929213 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:19.929234 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:00:19.929420 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:19.929424 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:19.929484 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:19.929585 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:00:19.930288 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.931233 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.933048 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.933903 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.934075 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.934147 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:19.934431 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 15:00:19.934558 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 15:00:19.935209 7386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.928798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:56863 (local address 127.12.73.129:40929)
0808 15:00:19.929077 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:19.929086 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:19.929872 (+ 786us) server_negotiation.cc:407] Connection header received
0808 15:00:19.930010 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:19.930015 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:19.930082 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:19.930152 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:00:19.930849 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.931809 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.933542 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.934310 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.934493 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.934567 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:19.934844 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 15:00:19.934970 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 15:00:19.935285 7406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.928697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:40929 (local address 127.12.73.131:56863)
0808 15:00:19.929752 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:19.929775 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 15:00:19.929897 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:00:19.930210 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:00:19.930213 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:00:19.930234 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:00:19.930672 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.930682 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.931976 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.931981 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.933390 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:00:19.933402 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.934518 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.934524 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:00:19.934674 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.934699 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 15:00:19.934811 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 15:00:19.934932 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":848,"thread_start_us":616,"threads_started":1}
I20260808 15:00:19.936272 7051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed8eab803434be7998912946cdf356d" candidate_uuid: "1e6e030aff824110b161ff3160c79077" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c93ab3e4ac574be387af68e3dac81f7a" is_pre_election: true
I20260808 15:00:19.936322 6828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed8eab803434be7998912946cdf356d" candidate_uuid: "1e6e030aff824110b161ff3160c79077" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" is_pre_election: true
I20260808 15:00:19.936882 7051 raft_consensus.cc:2454] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e6e030aff824110b161ff3160c79077 in term 0.
I20260808 15:00:19.936882 6828 raft_consensus.cc:2454] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e6e030aff824110b161ff3160c79077 in term 0.
I20260808 15:00:19.937678 7168 leader_election.cc:302] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6e030aff824110b161ff3160c79077, c93ab3e4ac574be387af68e3dac81f7a; no voters:
I20260808 15:00:19.938102 7403 raft_consensus.cc:2781] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:00:19.938235 7403 raft_consensus.cc:482] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:00:19.938347 7403 raft_consensus.cc:3037] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:00:19.940629 7403 raft_consensus.cc:504] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } }
I20260808 15:00:19.941493 7403 leader_election.cc:288] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [CANDIDATE]: Term 1 election: Requested vote from peers c93ab3e4ac574be387af68e3dac81f7a (127.12.73.130:43959), 8a5a5bf3febd49418a51ae53fcc19f89 (127.12.73.129:40929)
I20260808 15:00:19.941854 7051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed8eab803434be7998912946cdf356d" candidate_uuid: "1e6e030aff824110b161ff3160c79077" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c93ab3e4ac574be387af68e3dac81f7a"
I20260808 15:00:19.941934 6828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed8eab803434be7998912946cdf356d" candidate_uuid: "1e6e030aff824110b161ff3160c79077" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a5a5bf3febd49418a51ae53fcc19f89"
I20260808 15:00:19.942050 7051 raft_consensus.cc:3037] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:00:19.942193 6828 raft_consensus.cc:3037] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:00:19.944572 7051 raft_consensus.cc:2454] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6e030aff824110b161ff3160c79077 in term 1.
I20260808 15:00:19.944674 6828 raft_consensus.cc:2454] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6e030aff824110b161ff3160c79077 in term 1.
I20260808 15:00:19.945035 7168 leader_election.cc:302] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6e030aff824110b161ff3160c79077, c93ab3e4ac574be387af68e3dac81f7a; no voters:
I20260808 15:00:19.945398 7403 raft_consensus.cc:2781] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:00:19.945824 7403 raft_consensus.cc:686] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 1 LEADER]: Becoming Leader. State: Replica: 1e6e030aff824110b161ff3160c79077, State: Running, Role: LEADER
I20260808 15:00:19.946355 7403 consensus_queue.cc:237] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } } peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } }
I20260808 15:00:19.951529 6573 catalog_manager.cc:5495] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e6e030aff824110b161ff3160c79077 (127.12.73.131). New cstate: current_term: 1 leader_uuid: "1e6e030aff824110b161ff3160c79077" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6e030aff824110b161ff3160c79077" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 41559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 } health_report { overall_health: UNKNOWN } } }
W20260808 15:00:19.955619 6912 tablet.cc:2369] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:00:19.990368 7382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:19.985050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54872 (local address 127.12.73.131:41559)
0808 15:00:19.985351 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:19.985356 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:19.985442 (+ 86us) server_negotiation.cc:407] Connection header received
0808 15:00:19.985620 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:19.985623 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:19.985705 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:19.985847 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:00:19.986210 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.986927 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.988246 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:19.988656 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:19.988754 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:19.989295 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:00:19.989794 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:00:19.989913 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:19.989985 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 15:00:19.990050 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 15:00:19.999184 6828 raft_consensus.cc:1261] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89 [term 1 FOLLOWER]: Refusing update from remote peer 1e6e030aff824110b161ff3160c79077: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:00:19.999219 7051 raft_consensus.cc:1261] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a [term 1 FOLLOWER]: Refusing update from remote peer 1e6e030aff824110b161ff3160c79077: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:00:20.000397 7403 consensus_queue.cc:1035] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a5a5bf3febd49418a51ae53fcc19f89" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 40929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:00:20.000792 7407 consensus_queue.cc:1035] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c93ab3e4ac574be387af68e3dac81f7a" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 43959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:00:20.018373 7412 mvcc.cc:205] Tried to move back new op lower bound from 7316280197105156096 to 7316280196904210432. Current Snapshot: MvccSnapshot[applied={T|T < 7316280197105156096}]
I20260808 15:00:20.019150 7411 mvcc.cc:205] Tried to move back new op lower bound from 7316280197105156096 to 7316280196904210432. Current Snapshot: MvccSnapshot[applied={T|T < 7316280197105156096 or (T in {7316280197105156096})}]
I20260808 15:00:20.028976 6573 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35228:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:00:20.029294 6573 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35228:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:00:20.032799 6573 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Sending DeleteTablet for 3 replicas of tablet 9ed8eab803434be7998912946cdf356d
I20260808 15:00:20.034087 7021 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ed8eab803434be7998912946cdf356d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:00:20 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:49084
I20260808 15:00:20.034303 7255 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ed8eab803434be7998912946cdf356d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:00:20 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:54862
I20260808 15:00:20.034294 6794 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ed8eab803434be7998912946cdf356d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:00:20 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:36098
I20260808 15:00:20.035143 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 6642
I20260808 15:00:20.047519 7425 tablet_replica.cc:330] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077: stopping tablet replica
I20260808 15:00:20.047549 7426 tablet_replica.cc:330] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89: stopping tablet replica
I20260808 15:00:20.048029 7426 raft_consensus.cc:2229] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:00:20.048311 7425 raft_consensus.cc:2229] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:00:20.048662 7426 raft_consensus.cc:2258] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:00:20.049513 7425 raft_consensus.cc:2258] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:00:20.051471 7426 ts_tablet_manager.cc:1905] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:00:20.059024 7426 ts_tablet_manager.cc:1918] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:00:20.059041 7425 ts_tablet_manager.cc:1905] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:00:20.059755 7424 tablet_replica.cc:330] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a: stopping tablet replica
I20260808 15:00:20.060201 7424 raft_consensus.cc:2229] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:00:20.060735 7424 raft_consensus.cc:2258] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:00:20.061143 7426 log.cc:1196] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/9ed8eab803434be7998912946cdf356d
I20260808 15:00:20.061789 7426 ts_tablet_manager.cc:1939] T 9ed8eab803434be7998912946cdf356d P 8a5a5bf3febd49418a51ae53fcc19f89: Deleting consensus metadata
I20260808 15:00:20.063105 7424 ts_tablet_manager.cc:1905] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:00:20.063722 6543 catalog_manager.cc:4841] TS 8a5a5bf3febd49418a51ae53fcc19f89 (127.12.73.129:40929): tablet 9ed8eab803434be7998912946cdf356d (table test-table [id=455f3839e5da4db48b1ce79c866d9cd9]) successfully deleted
I20260808 15:00:20.064451 7386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:20.036015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36100 (local address 127.12.73.129:40929)
0808 15:00:20.036755 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:20.036763 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:20.036785 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:00:20.036861 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:20.036870 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:20.036971 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:20.037086 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:00:20.039772 (+ 2686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:20.041362 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:20.044385 (+ 3023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:20.045393 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:20.045546 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:20.051054 (+ 5508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:00:20.051067 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:00:20.051083 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:00:20.051123 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:00:20.056002 (+ 4879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:20.056931 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:20.056939 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:20.056945 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:20.057151 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:20.061754 (+ 4603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:20.061761 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:20.061773 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:20.062246 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:00:20.062554 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:20.063808 (+ 1254us) server_negotiation.cc:299] Negotiation successful
0808 15:00:20.064072 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576}
I20260808 15:00:20.065080 6899 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:00:20.070670 7424 ts_tablet_manager.cc:1918] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:00:20.070943 7424 log.cc:1196] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/9ed8eab803434be7998912946cdf356d
I20260808 15:00:20.071591 7424 ts_tablet_manager.cc:1939] T 9ed8eab803434be7998912946cdf356d P c93ab3e4ac574be387af68e3dac81f7a: Deleting consensus metadata
I20260808 15:00:20.071583 7425 ts_tablet_manager.cc:1918] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:00:20.071806 7425 log.cc:1196] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/9ed8eab803434be7998912946cdf356d
I20260808 15:00:20.072517 7425 ts_tablet_manager.cc:1939] T 9ed8eab803434be7998912946cdf356d P 1e6e030aff824110b161ff3160c79077: Deleting consensus metadata
I20260808 15:00:20.073814 6546 catalog_manager.cc:4841] TS c93ab3e4ac574be387af68e3dac81f7a (127.12.73.130:43959): tablet 9ed8eab803434be7998912946cdf356d (table test-table [id=455f3839e5da4db48b1ce79c866d9cd9]) successfully deleted
I20260808 15:00:20.074414 6543 catalog_manager.cc:4841] TS 1e6e030aff824110b161ff3160c79077 (127.12.73.131:41559): tablet 9ed8eab803434be7998912946cdf356d (table test-table [id=455f3839e5da4db48b1ce79c866d9cd9]) successfully deleted
I20260808 15:00:20.166116 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 6642
I20260808 15:00:20.204830 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 6916
I20260808 15:00:20.223781 7384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:20.205727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49100 (local address 127.12.73.130:43959)
0808 15:00:20.205902 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:20.205906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:20.205924 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:00:20.206109 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:20.206113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:20.206175 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:20.206255 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:00:20.208122 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:20.208927 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:20.211011 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:20.211636 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:20.211773 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:20.216293 (+ 4520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:00:20.216329 (+ 36us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:00:20.216352 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:00:20.216410 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:00:20.220464 (+ 4054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:20.221451 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:20.221461 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:20.221466 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:20.221616 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:20.222046 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:20.222051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:20.222055 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:20.222481 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:00:20.222814 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:20.223159 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 15:00:20.223394 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:00:20.224500 7125 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:00:20.331813 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 6916
I20260808 15:00:20.359915 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 7136
I20260808 15:00:20.375712 7382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:20.361419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54884 (local address 127.12.73.131:41559)
0808 15:00:20.361623 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:20.361627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:20.361650 (+ 23us) server_negotiation.cc:407] Connection header received
0808 15:00:20.361708 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:20.361712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:20.361784 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:20.361915 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:00:20.363431 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:20.364271 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:20.365723 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:20.366200 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:20.366383 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:20.369021 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:00:20.369037 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:00:20.369056 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:00:20.369099 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:00:20.372472 (+ 3373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:20.373267 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:20.373280 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:20.373286 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:20.373523 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:20.373943 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:20.373952 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:20.373956 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:20.374353 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:00:20.374725 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:20.375031 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 15:00:20.375284 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 15:00:20.376616 7354 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:00:20.507381 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 7136
I20260808 15:00:20.536671 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 6516
I20260808 15:00:20.537866 6626 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:00:20.650581 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 6516
I20260808 15:00:40.685740 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36799
--webserver_interface=127.12.73.190
--webserver_port=44631
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:36799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:00:41.035686 7433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:00:41.035969 7433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:00:41.036151 7433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:00:41.043509 7433 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 15:00:41.043610 7433 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 15:00:41.043699 7433 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 15:00:41.043790 7433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:00:41.043885 7433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:00:41.043992 7433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:00:41.044080 7433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:00:41.044157 7433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:00:41.054088 7433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:36799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=44631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:00:41.055404 7433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:00:41.056816 7433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:00:41.069116 7443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:41.069077 7445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:41.069026 7449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:00:41.070391 7433 server_base.cc:1034] running on GCE node
I20260808 15:00:41.071303 7433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:00:41.072834 7433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:00:41.074101 7433 hybrid_clock.cc:648] HybridClock initialized: now 1786201241073998 us; error 64 us; skew 500 ppm
I20260808 15:00:41.074460 7433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:00:41 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201241, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:00:41.082466 7433 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:00:41.083952 7433 webserver.cc:460] Webserver started at http://127.12.73.190:44631/ using document root <none> and password file <none>
I20260808 15:00:41.084640 7433 fs_manager.cc:359] Metadata directory not provided
I20260808 15:00:41.084733 7433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:00:41.090340 7433 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260808 15:00:41.093392 7458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:41.094787 7433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:00:41.094980 7433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "e7f33276b9144274978c2b14065f6b26"
format_stamp: "Formatted at 2026-08-08 14:59:55 on dist-test-slave-z8x9"
server_key: "f92c0e714c717ea9b67a51f8ce20bcc6"
server_key_iv: "924874cb609da75d481678822a5385bd"
server_key_version: "encryptionkey@0"
I20260808 15:00:41.095970 7433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:00:41.124905 7433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:00:41.129495 7433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:00:41.129807 7433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:00:41.149329 7433 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:36799
I20260808 15:00:41.149356 7541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:36799 every 8 connection(s)
I20260808 15:00:41.150816 7433 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:00:41.157814 7542 sys_catalog.cc:263] Verifying existing consensus state
I20260808 15:00:41.158978 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 7433
I20260808 15:00:41.160006 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:40929
--local_ip_for_outbound_sockets=127.12.73.129
--tserver_master_addrs=127.12.73.190:36799
--webserver_port=40149
--webserver_interface=127.12.73.129
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:00:41.162665 7542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Bootstrap starting.
I20260808 15:00:41.187134 7542 log.cc:824] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Log is configured to *not* fsync() on all Append() calls
I20260808 15:00:41.203565 7542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 15:00:41.204142 7542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Bootstrap complete.
I20260808 15:00:41.213594 7542 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } }
I20260808 15:00:41.214517 7542 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7f33276b9144274978c2b14065f6b26, State: Initialized, Role: FOLLOWER
I20260808 15:00:41.215186 7542 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } }
I20260808 15:00:41.215513 7542 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:00:41.215647 7542 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:00:41.215837 7542 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 2 FOLLOWER]: Advancing to term 3
I20260808 15:00:41.219735 7542 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } }
I20260808 15:00:41.220230 7542 leader_election.cc:302] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7f33276b9144274978c2b14065f6b26; no voters:
I20260808 15:00:41.220953 7542 leader_election.cc:288] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 15:00:41.221103 7547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 15:00:41.222472 7547 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [term 3 LEADER]: Becoming Leader. State: Replica: e7f33276b9144274978c2b14065f6b26, State: Running, Role: LEADER
I20260808 15:00:41.223104 7547 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } }
I20260808 15:00:41.223352 7542 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:00:41.225647 7550 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7f33276b9144274978c2b14065f6b26. Latest consensus state: current_term: 3 leader_uuid: "e7f33276b9144274978c2b14065f6b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } } }
I20260808 15:00:41.226083 7550 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: This master's current role is: LEADER
I20260808 15:00:41.225773 7549 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e7f33276b9144274978c2b14065f6b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7f33276b9144274978c2b14065f6b26" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36799 } } }
I20260808 15:00:41.226228 7549 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26 [sys.catalog]: This master's current role is: LEADER
I20260808 15:00:41.238572 7558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:00:41.248009 7558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:00:41.249647 7558 catalog_manager.cc:1259] Loaded cluster ID: b727265ee6724199b7435d29909cc072
I20260808 15:00:41.249802 7558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:00:41.253980 7558 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:00:41.255681 7558 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Loaded TSK: 0
I20260808 15:00:41.255901 7558 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e7f33276b9144274978c2b14065f6b26: Loaded TSK: 1
F20260808 15:00:41.257061 7558 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fcb4b1359ad google::LogMessage::Fail() at ??:0
@ 0x7fcb4b13888a google::LogMessage::SendToLog() at ??:0
@ 0x7fcb4b1354de google::LogMessage::Flush() at ??:0
@ 0x7fcb4b136a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fcb4ee997d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fcb4ee8873e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fcb60b641c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fcb60b63783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fcb60bef2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fcb60bef0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fcb60c395e9 std::function<>::operator()() at ??:0
@ 0x7fcb60b67cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fcb60b65c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fcb60bed610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fcb60bed439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fcb4dd81345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fcb4dd8491c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fcb4dd84799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fcb4dd5feaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fcb510396db start_thread at ??:0
@ 0x7fcb49fcf61f clone at ??:0
W20260808 15:00:41.554324 7545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:00:41.554648 7545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:00:41.554837 7545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:00:41.562346 7545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:00:41.562510 7545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:00:41.562711 7545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 15:00:41.572533 7545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:40929
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=40149
--tserver_master_addrs=127.12.73.190:36799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:00:41.573941 7545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:00:41.575368 7545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:00:41.588653 7619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:41.588722 7623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:41.588727 7628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:00:41.589879 7545 server_base.cc:1034] running on GCE node
I20260808 15:00:41.590497 7545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:00:41.591528 7545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:00:41.592782 7545 hybrid_clock.cc:648] HybridClock initialized: now 1786201241592728 us; error 42 us; skew 500 ppm
I20260808 15:00:41.593117 7545 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:00:41 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201241, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:00:41.596452 7545 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 15:00:41.598043 7545 webserver.cc:460] Webserver started at http://127.12.73.129:40149/ using document root <none> and password file <none>
I20260808 15:00:41.598680 7545 fs_manager.cc:359] Metadata directory not provided
I20260808 15:00:41.598786 7545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:00:41.604053 7545 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 15:00:41.606808 7639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:41.608171 7545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 15:00:41.608305 7545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "8a5a5bf3febd49418a51ae53fcc19f89"
format_stamp: "Formatted at 2026-08-08 14:59:55 on dist-test-slave-z8x9"
server_key: "423d572840559fc2116eb864adbc04db"
server_key_iv: "381b67a88c5017b5735669264ba30453"
server_key_version: "encryptionkey@0"
I20260808 15:00:41.609334 7545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:00:41.623052 7545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:00:41.627238 7545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:00:41.627468 7545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:00:41.628342 7545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:00:41.629689 7545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:00:41.629777 7545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:41.629864 7545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:00:41.629921 7545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:41.665330 7545 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:40929
I20260808 15:00:41.665418 7822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:40929 every 8 connection(s)
I20260808 15:00:41.666790 7545 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 15:00:41.671599 7826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:41.669865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:44759)
0808 15:00:41.670571 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:41.670802 (+ 231us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":277,"threads_started":1}
W20260808 15:00:41.672334 7823 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:36799 (0 consecutive failures): Network error: Failed to ping master at 127.12.73.190:36799: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
I20260808 15:00:41.673128 7826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:41.672813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:38709)
0808 15:00:41.672949 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:41.673025 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 15:00:41.673978 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 7545
I20260808 15:00:41.674161 7826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:41.673740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:36283)
0808 15:00:41.673908 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:41.674008 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 15:00:41.674417 7823 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 15:00:41.674773 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:43959
--local_ip_for_outbound_sockets=127.12.73.130
--tserver_master_addrs=127.12.73.190:36799
--webserver_port=43805
--webserver_interface=127.12.73.130
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:00:42.017791 7828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:00:42.018067 7828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:00:42.018247 7828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:00:42.025370 7828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:00:42.025478 7828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:00:42.025669 7828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 15:00:42.037055 7828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:43959
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=43805
--tserver_master_addrs=127.12.73.190:36799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:00:42.038537 7828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:00:42.039968 7828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:00:42.054065 7835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:42.054076 7838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:42.054123 7836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:00:42.055274 7828 server_base.cc:1034] running on GCE node
I20260808 15:00:42.055915 7828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:00:42.056881 7828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:00:42.058090 7828 hybrid_clock.cc:648] HybridClock initialized: now 1786201242058029 us; error 56 us; skew 500 ppm
I20260808 15:00:42.058435 7828 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:00:42 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201242, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:00:42.061764 7828 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 15:00:42.063184 7828 webserver.cc:460] Webserver started at http://127.12.73.130:43805/ using document root <none> and password file <none>
I20260808 15:00:42.063827 7828 fs_manager.cc:359] Metadata directory not provided
I20260808 15:00:42.063942 7828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:00:42.070060 7828 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 15:00:42.072837 7851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:42.074287 7828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:00:42.074476 7828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "c93ab3e4ac574be387af68e3dac81f7a"
format_stamp: "Formatted at 2026-08-08 14:59:56 on dist-test-slave-z8x9"
server_key: "9606d766c5af7fe07efb1a33d23539d7"
server_key_iv: "6edf2afca690c586a2f46990b9e9f859"
server_key_version: "encryptionkey@0"
I20260808 15:00:42.075573 7828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:00:42.091974 7828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:00:42.095767 7828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:00:42.096053 7828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:00:42.097011 7828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:00:42.098361 7828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:00:42.098450 7828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:42.098605 7828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:00:42.098681 7828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:42.134102 7828 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:43959
I20260808 15:00:42.134174 8058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:43959 every 8 connection(s)
I20260808 15:00:42.135591 7828 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 15:00:42.136900 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 7828
I20260808 15:00:42.137706 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:41559
--local_ip_for_outbound_sockets=127.12.73.131
--tserver_master_addrs=127.12.73.190:36799
--webserver_port=36521
--webserver_interface=127.12.73.131
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:00:42.140988 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:42.139128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:33649)
0808 15:00:42.139933 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:42.140159 (+ 226us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":326,"threads_started":1}
W20260808 15:00:42.141724 8059 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:36799 (0 consecutive failures): Network error: Failed to ping master at 127.12.73.190:36799: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
I20260808 15:00:42.142602 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:42.142276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:53791)
0808 15:00:42.142429 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:42.142493 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 15:00:42.143422 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:42.143095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:36919)
0808 15:00:42.143234 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:42.143313 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 15:00:42.143644 8059 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 15:00:42.479385 8065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:00:42.479776 8065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:00:42.479964 8065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:00:42.487178 8065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:00:42.487299 8065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:00:42.487411 8065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 15:00:42.496628 8065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:41559
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=36521
--tserver_master_addrs=127.12.73.190:36799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:00:42.497922 8065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:00:42.499215 8065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:00:42.512131 8079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:42.512202 8082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:00:42.512444 8078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:00:42.513089 8065 server_base.cc:1034] running on GCE node
I20260808 15:00:42.513813 8065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:00:42.514767 8065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:00:42.516003 8065 hybrid_clock.cc:648] HybridClock initialized: now 1786201242515947 us; error 53 us; skew 500 ppm
I20260808 15:00:42.516346 8065 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:00:42 dist-test-slave-z8x9 krb5kdc[5571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201242, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:00:42.519466 8065 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 15:00:42.520920 8065 webserver.cc:460] Webserver started at http://127.12.73.131:36521/ using document root <none> and password file <none>
I20260808 15:00:42.521672 8065 fs_manager.cc:359] Metadata directory not provided
I20260808 15:00:42.521826 8065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:00:42.526981 8065 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 15:00:42.529608 8093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:42.530836 8065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:00:42.531018 8065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "1e6e030aff824110b161ff3160c79077"
format_stamp: "Formatted at 2026-08-08 14:59:56 on dist-test-slave-z8x9"
server_key: "006394a072fc1e93c42e8318e0e594a4"
server_key_iv: "d883165376974c0cbcd0859c2b3b08d5"
server_key_version: "encryptionkey@0"
I20260808 15:00:42.531992 8065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:00:42.575930 8065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:00:42.580380 8065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:00:42.580669 8065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:00:42.581877 8065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:00:42.583235 8065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:00:42.583361 8065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:42.583484 8065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:00:42.583572 8065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:00:42.618610 8065 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:41559
I20260808 15:00:42.618705 8298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:41559 every 8 connection(s)
I20260808 15:00:42.620065 8065 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 15:00:42.624876 8302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:42.623058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:60193)
0808 15:00:42.623796 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:42.624057 (+ 261us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":283,"threads_started":1}
W20260808 15:00:42.625674 8300 heartbeater.cc:644] Failed to heartbeat to 127.12.73.190:36799 (0 consecutive failures): Network error: Failed to ping master at 127.12.73.190:36799: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
I20260808 15:00:42.626446 8302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:42.626135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:59061)
0808 15:00:42.626278 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:42.626346 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 15:00:42.627249 8302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:42.626958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:39455)
0808 15:00:42.627066 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:42.627133 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 15:00:42.627518 8300 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 15:00:42.629607 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 8065
I20260808 15:00:42.678242 8306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:42.676170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:32863)
0808 15:00:42.677763 (+ 1593us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:42.677930 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1425,"thread_start_us":1270,"threads_started":1}
I20260808 15:00:43.144997 8307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:43.144143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:42139)
0808 15:00:43.144651 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:43.144762 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":259,"threads_started":1}
I20260808 15:00:43.628904 8309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:43.628066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:35597)
0808 15:00:43.628574 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:43.628664 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":256,"threads_started":1}
I20260808 15:00:43.679939 8311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:43.679163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:56287)
0808 15:00:43.679688 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:43.679770 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":233,"threads_started":1}
I20260808 15:00:44.146663 8312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:44.145922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:49317)
0808 15:00:44.146420 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:44.146498 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":285,"threads_started":1}
I20260808 15:00:44.630559 8314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:44.629883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:50937)
0808 15:00:44.630327 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:44.630407 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":219,"threads_started":1}
I20260808 15:00:44.681481 8315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:44.680750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:49697)
0808 15:00:44.681159 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:44.681301 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":219,"threads_started":1}
I20260808 15:00:45.148097 8317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:45.147428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:42149)
0808 15:00:45.147854 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:45.147932 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":223,"threads_started":1}
I20260808 15:00:45.632463 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:45.631599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:36525)
0808 15:00:45.632158 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:45.632272 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":326,"threads_started":1}
I20260808 15:00:45.683097 8319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:45.682383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:36967)
0808 15:00:45.682806 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:45.682900 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":214,"threads_started":1}
I20260808 15:00:46.149820 8320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:46.149024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:34243)
0808 15:00:46.149541 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:46.149623 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":300,"threads_started":1}
I20260808 15:00:46.634083 8321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:46.633405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:41329)
0808 15:00:46.633846 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:46.633924 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":228,"threads_started":1}
I20260808 15:00:46.684695 8324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:46.683984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:47225)
0808 15:00:46.684454 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:46.684533 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":252,"threads_started":1}
I20260808 15:00:47.151353 8326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:47.150655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:37967)
0808 15:00:47.151101 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:47.151192 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":234,"threads_started":1}
I20260808 15:00:47.635799 8328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:47.635047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:55811)
0808 15:00:47.635559 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:47.635637 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":302,"threads_started":1}
I20260808 15:00:47.686403 8330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:47.685687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:49605)
0808 15:00:47.686151 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:47.686240 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":247,"threads_started":1}
I20260808 15:00:48.153048 8331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:48.152291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:44803)
0808 15:00:48.152796 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:48.152886 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":290,"threads_started":1}
I20260808 15:00:48.637549 8332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:48.636677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:51875)
0808 15:00:48.637250 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:48.637345 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":286,"threads_started":1}
I20260808 15:00:48.688195 8333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:48.687414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:56679)
0808 15:00:48.687898 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:48.687980 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":211,"threads_started":1}
I20260808 15:00:49.154835 8334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:49.154027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:60081)
0808 15:00:49.154513 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:49.154596 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":215,"threads_started":1}
I20260808 15:00:49.639132 8335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:49.638364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:39889)
0808 15:00:49.638836 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:49.638927 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":226,"threads_started":1}
I20260808 15:00:49.689946 8337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:49.689136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:35667)
0808 15:00:49.689706 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:49.689784 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":311,"threads_started":1}
I20260808 15:00:50.156482 8344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:50.155735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:41441)
0808 15:00:50.156215 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:50.156307 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":239,"threads_started":1}
I20260808 15:00:50.640640 8348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:50.639976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:58541)
0808 15:00:50.640401 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:50.640483 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":224,"threads_started":1}
I20260808 15:00:50.691672 8349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:50.690961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:32871)
0808 15:00:50.691425 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:50.691505 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":223,"threads_started":1}
I20260808 15:00:51.158145 8350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:51.157428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:56449)
0808 15:00:51.157893 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:51.157974 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":234,"threads_started":1}
I20260808 15:00:51.642261 8351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:51.641506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:35729)
0808 15:00:51.641967 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:51.642047 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":233,"threads_started":1}
I20260808 15:00:51.693311 8353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:51.692528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:37267)
0808 15:00:51.692983 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:51.693066 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":256,"threads_started":1}
I20260808 15:00:52.159907 8356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:52.159151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:34393)
0808 15:00:52.159636 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:52.159726 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":267,"threads_started":1}
I20260808 15:00:52.643855 8358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:52.643132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:48675)
0808 15:00:52.643606 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:52.643686 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":260,"threads_started":1}
I20260808 15:00:52.697451 8359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:52.695888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:49177)
0808 15:00:52.697042 (+ 1154us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:52.697147 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1053,"thread_start_us":929,"threads_started":1}
I20260808 15:00:53.161605 8361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:53.160857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:42123)
0808 15:00:53.161319 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:53.161422 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":209,"threads_started":1}
I20260808 15:00:53.645457 8363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:53.644662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:39997)
0808 15:00:53.645129 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:53.645265 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":236,"threads_started":1}
I20260808 15:00:53.698953 8364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:53.698287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:34695)
0808 15:00:53.698715 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:53.698795 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":217,"threads_started":1}
I20260808 15:00:54.163095 8365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:54.162453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:34555)
0808 15:00:54.162863 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:54.162942 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":203,"threads_started":1}
I20260808 15:00:54.646973 8368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:54.646312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:57031)
0808 15:00:54.646728 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:54.646808 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":210,"threads_started":1}
I20260808 15:00:54.700559 8369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:54.699753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:57747)
0808 15:00:54.700270 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:54.700369 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":263,"threads_started":1}
I20260808 15:00:55.164868 8371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:55.164079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:53313)
0808 15:00:55.164578 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:55.164675 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":264,"threads_started":1}
I20260808 15:00:55.648598 8372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:55.647794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:55329)
0808 15:00:55.648322 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:55.648416 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":300,"threads_started":1}
I20260808 15:00:55.702138 8373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:55.701459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:45917)
0808 15:00:55.701881 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:55.701959 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":221,"threads_started":1}
I20260808 15:00:56.166561 8374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:56.165809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:52589)
0808 15:00:56.166287 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:56.166372 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":227,"threads_started":1}
I20260808 15:00:56.650228 8375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:56.649555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:52253)
0808 15:00:56.649960 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:56.650048 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":206,"threads_started":1}
I20260808 15:00:56.703886 8376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:56.703187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.129:44559)
0808 15:00:56.703619 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:56.703706 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":218,"threads_started":1}
I20260808 15:00:57.168624 8379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:57.167750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.130:48271)
0808 15:00:57.168341 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:57.168432 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":313,"threads_started":1}
I20260808 15:00:57.631414 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 7545
I20260808 15:00:57.649722 8380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:57.632581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43790 (local address 127.12.73.129:40929)
0808 15:00:57.633207 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:57.633227 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:57.633301 (+ 74us) server_negotiation.cc:407] Connection header received
0808 15:00:57.635382 (+ 2081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:57.635393 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:57.635809 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:57.636143 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:00:57.637681 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:57.638890 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:57.640120 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:57.640756 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:57.640896 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:57.643494 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:00:57.643502 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:00:57.643516 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:00:57.643554 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:00:57.646732 (+ 3178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:57.647391 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:57.647397 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:57.647403 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:57.647568 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:57.647964 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:57.647967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:57.647969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:57.648465 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:00:57.648700 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:57.649048 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 15:00:57.649434 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":307,"threads_started":1}
I20260808 15:00:57.651142 7815 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:00:57.652333 8386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:57.651432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36799 (local address 127.12.73.131:53145)
0808 15:00:57.651948 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0808 15:00:57.652088 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.190:36799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":293,"threads_started":1}
I20260808 15:00:57.735977 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 7545
I20260808 15:00:57.762562 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 7828
I20260808 15:00:57.785449 8390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:57.763593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40000 (local address 127.12.73.130:43959)
0808 15:00:57.764113 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:57.764129 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:57.764166 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:00:57.765850 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:57.765860 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:57.766274 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:57.766622 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:00:57.768205 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:57.769558 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:57.770820 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:57.771492 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:57.771695 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:57.778891 (+ 7196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:00:57.778899 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:00:57.778914 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:00:57.778953 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:00:57.781935 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:57.782657 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:57.782664 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:57.782671 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:57.782846 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:57.783262 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:57.783268 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:57.783272 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:57.783823 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:00:57.784148 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:57.784642 (+ 494us) server_negotiation.cc:299] Negotiation successful
0808 15:00:57.785090 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":236,"threads_started":1}
I20260808 15:00:57.786811 8052 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:00:57.870926 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 7828
I20260808 15:00:57.898733 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 8065
I20260808 15:00:57.917647 8392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:00:57.899861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38766 (local address 127.12.73.131:41559)
0808 15:00:57.900439 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0808 15:00:57.900453 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:00:57.900496 (+ 43us) server_negotiation.cc:407] Connection header received
0808 15:00:57.902289 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:00:57.902300 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:00:57.902730 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:00:57.903083 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:00:57.904566 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:57.905893 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:57.907289 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:00:57.907969 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:00:57.908184 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:00:57.911085 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:00:57.911093 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:00:57.911110 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:00:57.911147 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:00:57.914154 (+ 3007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:57.914840 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:57.914848 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:57.914855 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:57.915028 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:00:57.915478 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:00:57.915483 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:00:57.915486 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:00:57.916027 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:00:57.916326 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0808 15:00:57.916842 (+ 516us) server_negotiation.cc:299] Negotiation successful
0808 15:00:57.917339 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":279,"threads_started":1}
I20260808 15:00:57.919020 8294 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:00:58.001672 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 8065
2026-08-08T15:00:58Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64970 ms)
[----------] 30 tests from SecurityITest (305088 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:00:58 dist-test-slave-z8x9 krb5kdc[8397](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:00:58 dist-test-slave-z8x9 krb5kdc[8397](info): set up 2 sockets
Aug 08 15:00:58 dist-test-slave-z8x9 krb5kdc[8397](info): commencing operation
krb5kdc: starting...
W20260808 15:00:59.394645 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.343s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:00:59 dist-test-slave-z8x9 krb5kdc[8397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:00:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:00:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 15:00:59.710748 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36071
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:36071
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:00.050357 8417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:00.050621 8417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:00.050804 8417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:00.057896 8417 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:00.058033 8417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:00.058121 8417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:00.058225 8417 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:00.058316 8417 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:00.067860 8417 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:36071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:36071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:00.069116 8417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:00.070513 8417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:00.082280 8432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:00.082408 8426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:00.082369 8429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:00.083285 8417 server_base.cc:1034] running on GCE node
I20260808 15:01:00.084064 8417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:00.085479 8417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:00.086687 8417 hybrid_clock.cc:648] HybridClock initialized: now 1786201260086646 us; error 39 us; skew 500 ppm
I20260808 15:01:00.087054 8417 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:00 dist-test-slave-z8x9 krb5kdc[8397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201260, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:00.090505 8417 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:01:00.092015 8417 webserver.cc:460] Webserver started at http://127.12.73.190:33947/ using document root <none> and password file <none>
I20260808 15:01:00.092734 8417 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:00.092866 8417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:00.093254 8417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:00.096531 8417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "0a285de5c24648dd8a810ec0a923fb0e"
format_stamp: "Formatted at 2026-08-08 15:01:00 on dist-test-slave-z8x9"
server_key: "6659602dde3ced458e9cd406e8f0e47e"
server_key_iv: "bc041c02d362d9aec6235e21e83baaf0"
server_key_version: "encryptionkey@0"
I20260808 15:01:00.097636 8417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "0a285de5c24648dd8a810ec0a923fb0e"
format_stamp: "Formatted at 2026-08-08 15:01:00 on dist-test-slave-z8x9"
server_key: "6659602dde3ced458e9cd406e8f0e47e"
server_key_iv: "bc041c02d362d9aec6235e21e83baaf0"
server_key_version: "encryptionkey@0"
I20260808 15:01:00.103544 8417 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 15:01:00.107071 8443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:00.108417 8417 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:01:00.108704 8417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "0a285de5c24648dd8a810ec0a923fb0e"
format_stamp: "Formatted at 2026-08-08 15:01:00 on dist-test-slave-z8x9"
server_key: "6659602dde3ced458e9cd406e8f0e47e"
server_key_iv: "bc041c02d362d9aec6235e21e83baaf0"
server_key_version: "encryptionkey@0"
I20260808 15:01:00.108911 8417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:00.125608 8417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:00.130252 8417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:00.130553 8417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:00.148653 8417 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:36071
I20260808 15:01:00.148672 8538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:36071 every 8 connection(s)
I20260808 15:01:00.150082 8417 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:00.150722 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 8417
I20260808 15:01:00.150960 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:00.151974 12582 external_mini_cluster.cc:1428] Setting key 4c734a07f416c76fa4b6fe2cc2dace54
I20260808 15:01:00.154821 8539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:00.165532 8539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e: Bootstrap starting.
Aug 08 15:01:00 dist-test-slave-z8x9 krb5kdc[8397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:00.168792 8539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:00.170219 8539 log.cc:824] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:00.173676 8539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e: No bootstrap required, opened a new log
I20260808 15:01:00.175819 8543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:00.154035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47442 (local address 127.12.73.190:36071)
0808 15:01:00.154871 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:00.154909 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:00.154960 (+ 51us) server_negotiation.cc:407] Connection header received
0808 15:01:00.156601 (+ 1641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:00.156623 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:00.156998 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:00.157492 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:00.159030 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:00.160405 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:00.161858 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:00.162543 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:00.162778 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:00.167120 (+ 4342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:00.167128 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:00.167141 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:00.167177 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:00.171089 (+ 3912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:00.171981 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:00.171989 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:00.171996 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:00.172261 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:00.172644 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:00.172650 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:00.172653 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:00.173366 (+ 713us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:00.173711 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:00.174002 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 15:01:00.174487 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":411,"threads_started":1}
I20260808 15:01:00.182482 8539 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a285de5c24648dd8a810ec0a923fb0e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36071 } }
I20260808 15:01:00.182955 8539 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:00.183092 8539 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a285de5c24648dd8a810ec0a923fb0e, State: Initialized, Role: FOLLOWER
I20260808 15:01:00.183653 8539 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a285de5c24648dd8a810ec0a923fb0e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36071 } }
I20260808 15:01:00.183888 8539 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:00.184049 8539 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:00.184233 8539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:00.186756 8539 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a285de5c24648dd8a810ec0a923fb0e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36071 } }
I20260808 15:01:00.187252 8539 leader_election.cc:302] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a285de5c24648dd8a810ec0a923fb0e; no voters:
I20260808 15:01:00.187873 8539 leader_election.cc:288] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:00.188022 8547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:00.188715 8547 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [term 1 LEADER]: Becoming Leader. State: Replica: 0a285de5c24648dd8a810ec0a923fb0e, State: Running, Role: LEADER
I20260808 15:01:00.189371 8547 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a285de5c24648dd8a810ec0a923fb0e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36071 } }
I20260808 15:01:00.189998 8539 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:00.192327 8548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a285de5c24648dd8a810ec0a923fb0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a285de5c24648dd8a810ec0a923fb0e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36071 } } }
I20260808 15:01:00.192283 8549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a285de5c24648dd8a810ec0a923fb0e. Latest consensus state: current_term: 1 leader_uuid: "0a285de5c24648dd8a810ec0a923fb0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a285de5c24648dd8a810ec0a923fb0e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 36071 } } }
I20260808 15:01:00.192728 8548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:00.192752 8549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:00.195325 8558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:00.200733 8558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:00.209249 8558 catalog_manager.cc:1347] Generated new cluster ID: ce9c0a84be474593b19242647e0f19b1
I20260808 15:01:00.209362 8558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:00.230134 8558 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:00.231750 8558 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:00.238300 8558 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e: Generated new TSK 0
I20260808 15:01:00.239092 8558 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 15:01:00.317535 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36071
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:00.664425 8578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:00.664876 8578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:00.665095 8578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:00.674167 8578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:00.674337 8578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:00.674556 8578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 15:01:00.684806 8578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:00.686167 8578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:00.687479 8578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:00.704053 8585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:00.704089 8586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:00.704393 8589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:00.705541 8578 server_base.cc:1034] running on GCE node
I20260808 15:01:00.706172 8578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:00.707158 8578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:00.708398 8578 hybrid_clock.cc:648] HybridClock initialized: now 1786201260708339 us; error 47 us; skew 500 ppm
I20260808 15:01:00.708711 8578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:00 dist-test-slave-z8x9 krb5kdc[8397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201260, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:00.712085 8578 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 15:01:00.713862 8578 webserver.cc:460] Webserver started at http://127.12.73.129:41271/ using document root <none> and password file <none>
I20260808 15:01:00.714540 8578 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:00.714674 8578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:00.714996 8578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:00.717965 8578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "3da166410bf840dc9ef049fa613957b9"
format_stamp: "Formatted at 2026-08-08 15:01:00 on dist-test-slave-z8x9"
server_key: "0173bb1c5eb93c3dd35d834980ff1eb7"
server_key_iv: "9b9d9d6bbc37ad95db489c8a6532bf3a"
server_key_version: "encryptionkey@0"
I20260808 15:01:00.718760 8578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "3da166410bf840dc9ef049fa613957b9"
format_stamp: "Formatted at 2026-08-08 15:01:00 on dist-test-slave-z8x9"
server_key: "0173bb1c5eb93c3dd35d834980ff1eb7"
server_key_iv: "9b9d9d6bbc37ad95db489c8a6532bf3a"
server_key_version: "encryptionkey@0"
I20260808 15:01:00.724123 8578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 15:01:00.727656 8601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:00.729015 8578 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:01:00.729249 8578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "3da166410bf840dc9ef049fa613957b9"
format_stamp: "Formatted at 2026-08-08 15:01:00 on dist-test-slave-z8x9"
server_key: "0173bb1c5eb93c3dd35d834980ff1eb7"
server_key_iv: "9b9d9d6bbc37ad95db489c8a6532bf3a"
server_key_version: "encryptionkey@0"
I20260808 15:01:00.729446 8578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:00.748827 8578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:00.753041 8578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:00.753353 8578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:00.754344 8578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:00.755649 8578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:00.755754 8578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:00.755905 8578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:00.755976 8578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:00.790951 8578 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:45331
I20260808 15:01:00.790963 8781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:45331 every 8 connection(s)
I20260808 15:01:00.792244 8578 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 15:01:00.800356 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 8578
I20260808 15:01:00.800591 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 15:01:00.801302 12582 external_mini_cluster.cc:1428] Setting key 2b59913674931617f977a963aad5349d
Aug 08 15:01:00 dist-test-slave-z8x9 krb5kdc[8397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201260, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:00.812433 8784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:00.794819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:38545 (local address 127.12.73.190:36071)
0808 15:01:00.795315 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:00.795322 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:00.796293 (+ 971us) server_negotiation.cc:407] Connection header received
0808 15:01:00.798178 (+ 1885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:00.798183 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:00.798259 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:00.798361 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:00.799814 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:00.800658 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:00.802327 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:00.802754 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:00.802913 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:00.806700 (+ 3787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:00.806705 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:00.806708 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:00.806740 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:00.809250 (+ 2510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:00.810006 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:00.810012 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:00.810015 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:00.810157 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:00.810599 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:00.810603 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:00.810605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:00.810887 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:00.811047 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:00.811751 (+ 704us) server_negotiation.cc:299] Negotiation successful
0808 15:01:00.811994 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":242,"threads_started":1}
I20260808 15:01:00.813484 8785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:00.795418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36071 (local address 127.12.73.129:38545)
0808 15:01:00.796131 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:00.796169 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:00.797927 (+ 1758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:00.798567 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:00.798574 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:00.799115 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:00.799661 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:00.799678 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:00.800830 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:00.800835 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:00.802169 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:00.802182 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:00.803017 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:00.803026 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:00.803251 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:00.803993 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:01:00.804031 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:00.806475 (+ 2444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:00.809399 (+ 2924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:00.809407 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:00.809422 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:00.809875 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:00.810271 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:00.810276 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:00.810279 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:00.810475 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:00.811020 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:00.811028 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:00.811372 (+ 344us) client_negotiation.cc:769] Sending connection context
0808 15:01:00.811638 (+ 266us) client_negotiation.cc:240] Negotiation successful
0808 15:01:00.812217 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":305,"threads_started":1}
I20260808 15:01:00.815102 8782 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36071
I20260808 15:01:00.815438 8782 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:00.816309 8782 heartbeater.cc:511] Master 127.12.73.190:36071 requested a full tablet report, sending...
I20260808 15:01:00.818500 8470 ts_manager.cc:194] Registered new tserver with Master: 3da166410bf840dc9ef049fa613957b9 (127.12.73.129:45331)
I20260808 15:01:00.820636 8470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:38545
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 15:01:00.876709 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36071
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:01.221074 8788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:01.221403 8788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:01.221513 8788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:01.228964 8788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:01.229076 8788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:01.229285 8788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 15:01:01.239293 8788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:01.240510 8788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:01.241811 8788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:01.255122 8797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:01.255038 8801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:01.255086 8796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:01.256274 8788 server_base.cc:1034] running on GCE node
I20260808 15:01:01.256875 8788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:01.257887 8788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:01.259090 8788 hybrid_clock.cc:648] HybridClock initialized: now 1786201261259056 us; error 34 us; skew 500 ppm
I20260808 15:01:01.259351 8788 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:01 dist-test-slave-z8x9 krb5kdc[8397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201261, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:01.262583 8788 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 15:01:01.264050 8788 webserver.cc:460] Webserver started at http://127.12.73.130:39949/ using document root <none> and password file <none>
I20260808 15:01:01.264719 8788 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:01.264871 8788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:01.265237 8788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:01.268168 8788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "962f954dc7594d3783aee9c0632ba053"
format_stamp: "Formatted at 2026-08-08 15:01:01 on dist-test-slave-z8x9"
server_key: "aafeb5375dbef338fa225b6fe7d9f179"
server_key_iv: "45397d02cba1dbe25b630b839343a370"
server_key_version: "encryptionkey@0"
I20260808 15:01:01.268930 8788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "962f954dc7594d3783aee9c0632ba053"
format_stamp: "Formatted at 2026-08-08 15:01:01 on dist-test-slave-z8x9"
server_key: "aafeb5375dbef338fa225b6fe7d9f179"
server_key_iv: "45397d02cba1dbe25b630b839343a370"
server_key_version: "encryptionkey@0"
I20260808 15:01:01.273988 8788 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260808 15:01:01.277370 8813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:01.278568 8788 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:01:01.278770 8788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "962f954dc7594d3783aee9c0632ba053"
format_stamp: "Formatted at 2026-08-08 15:01:01 on dist-test-slave-z8x9"
server_key: "aafeb5375dbef338fa225b6fe7d9f179"
server_key_iv: "45397d02cba1dbe25b630b839343a370"
server_key_version: "encryptionkey@0"
I20260808 15:01:01.278990 8788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:01.311210 8788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:01.315521 8788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:01.315817 8788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:01.316756 8788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:01.318192 8788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:01.318295 8788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:01.318455 8788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:01.318531 8788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:01.353295 8788 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:35415
I20260808 15:01:01.353406 8998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:35415 every 8 connection(s)
I20260808 15:01:01.354733 8788 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 15:01:01.358985 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 8788
I20260808 15:01:01.359191 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 15:01:01.359647 12582 external_mini_cluster.cc:1428] Setting key 80d49f1d7794d912d0087145cdf3db53
Aug 08 15:01:01 dist-test-slave-z8x9 krb5kdc[8397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201261, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:01.374963 9002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:01.357696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:41693 (local address 127.12.73.190:36071)
0808 15:01:01.358150 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:01.358154 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:01.359017 (+ 863us) server_negotiation.cc:407] Connection header received
0808 15:01:01.360945 (+ 1928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:01.360951 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:01.361047 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:01.361167 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:01.362646 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.363363 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.364924 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.365425 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.365558 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:01.369257 (+ 3699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:01.369261 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:01.369265 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:01.369296 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:01.371938 (+ 2642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:01.372627 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:01.372633 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:01.372636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:01.372762 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:01.373213 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:01.373223 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:01.373225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:01.373511 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:01.373668 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:01.374364 (+ 696us) server_negotiation.cc:299] Negotiation successful
0808 15:01:01.374600 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":255,"threads_started":1}
I20260808 15:01:01.375880 9003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:01.358170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36071 (local address 127.12.73.130:41693)
0808 15:01:01.358856 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:01.358894 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:01.360680 (+ 1786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:01.361429 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:01.361436 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:01.361938 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:01.362481 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:01.362497 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.363545 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.363549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:01.364783 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:01.364795 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.365665 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.365674 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:01.365889 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:01.366606 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:01:01.366632 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:01.369005 (+ 2373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:01.372073 (+ 3068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:01.372082 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:01.372095 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:01.372502 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:01.372874 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:01.372879 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:01.372883 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:01.373062 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:01.373639 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:01.373646 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:01.373981 (+ 335us) client_negotiation.cc:769] Sending connection context
0808 15:01:01.374264 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 15:01:01.374762 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":279,"threads_started":1}
I20260808 15:01:01.377364 8999 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36071
I20260808 15:01:01.377719 8999 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:01.378571 8999 heartbeater.cc:511] Master 127.12.73.190:36071 requested a full tablet report, sending...
I20260808 15:01:01.380198 8470 ts_manager.cc:194] Registered new tserver with Master: 962f954dc7594d3783aee9c0632ba053 (127.12.73.130:35415)
I20260808 15:01:01.381522 8470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:41693
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 15:01:01.430738 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36071
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:43205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:01.776746 9011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:01.777076 9011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:01.777251 9011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:01.784754 9011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:01.784865 9011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:01.784983 9011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 15:01:01.794891 9011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:43205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:36071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:01.796139 9011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:01.797451 9011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:01.810465 9018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:01.810556 9017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:01.810508 9020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:01.811685 9011 server_base.cc:1034] running on GCE node
I20260808 15:01:01.812366 9011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:01.813395 9011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:01.814646 9011 hybrid_clock.cc:648] HybridClock initialized: now 1786201261814567 us; error 65 us; skew 500 ppm
I20260808 15:01:01.815026 9011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:01 dist-test-slave-z8x9 krb5kdc[8397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201261, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:01.818267 9011 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 15:01:01.819644 9011 webserver.cc:460] Webserver started at http://127.12.73.131:33731/ using document root <none> and password file <none>
I20260808 15:01:01.820273 9011 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:01.820387 9011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:01.820647 9011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:01.823556 9011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "17df93dd81a447a88ff361b6f87f5842"
format_stamp: "Formatted at 2026-08-08 15:01:01 on dist-test-slave-z8x9"
server_key: "c578fd2835c8e71913765848f5f231b6"
server_key_iv: "c219a09aabca041890a9949e4a2f2014"
server_key_version: "encryptionkey@0"
I20260808 15:01:01.824291 9011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "17df93dd81a447a88ff361b6f87f5842"
format_stamp: "Formatted at 2026-08-08 15:01:01 on dist-test-slave-z8x9"
server_key: "c578fd2835c8e71913765848f5f231b6"
server_key_iv: "c219a09aabca041890a9949e4a2f2014"
server_key_version: "encryptionkey@0"
I20260808 15:01:01.824299 8782 heartbeater.cc:503] Master 127.12.73.190:36071 was elected leader, sending a full tablet report...
I20260808 15:01:01.829917 9011 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 15:01:01.833422 9034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:01.834745 9011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:01:01.834932 9011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "17df93dd81a447a88ff361b6f87f5842"
format_stamp: "Formatted at 2026-08-08 15:01:01 on dist-test-slave-z8x9"
server_key: "c578fd2835c8e71913765848f5f231b6"
server_key_iv: "c219a09aabca041890a9949e4a2f2014"
server_key_version: "encryptionkey@0"
I20260808 15:01:01.835142 9011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:01.857223 9011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:01.861261 9011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:01.861557 9011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:01.862525 9011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:01.863883 9011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:01.863967 9011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:01.864146 9011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:01.864200 9011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:01.898646 9011 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:43437
I20260808 15:01:01.898726 9220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:43437 every 8 connection(s)
I20260808 15:01:01.899977 9011 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 15:01:01.901377 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 9011
I20260808 15:01:01.901575 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 15:01:01.902161 12582 external_mini_cluster.cc:1428] Setting key ef52d7021fe2cd33395c7262dfd81b9c
Aug 08 15:01:01 dist-test-slave-z8x9 krb5kdc[8397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201261, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:01.920562 9227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:01.902812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:40761 (local address 127.12.73.190:36071)
0808 15:01:01.903547 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:01.903555 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:01.904523 (+ 968us) server_negotiation.cc:407] Connection header received
0808 15:01:01.906494 (+ 1971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:01.906498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:01.906576 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:01.906664 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:01.908075 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.908847 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.910385 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.910779 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.910873 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:01.914452 (+ 3579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:01.914456 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:01.914460 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:01.914491 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:01.917495 (+ 3004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:01.918219 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:01.918224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:01.918226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:01.918352 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:01.918795 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:01.918805 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:01.918807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:01.919079 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:01.919247 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:01.919964 (+ 717us) server_negotiation.cc:299] Negotiation successful
0808 15:01:01.920186 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":459,"threads_started":1}
I20260808 15:01:01.921622 9228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:01.903481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:36071 (local address 127.12.73.131:40761)
0808 15:01:01.904347 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:01.904400 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:01.906250 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:01.906867 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:01.906874 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:01.907391 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:01.907932 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:01.907949 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.908967 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.908971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:01.910251 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:01.910264 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.910965 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.910969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:01.911156 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:01.911795 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:01:01.911817 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:01.914246 (+ 2429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:01.917633 (+ 3387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:01.917642 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:01.917663 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:01.918080 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:01.918466 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:01.918471 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:01.918476 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:01.918663 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:01.919214 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:01.919222 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:01.919566 (+ 344us) client_negotiation.cc:769] Sending connection context
0808 15:01:01.919833 (+ 267us) client_negotiation.cc:240] Negotiation successful
0808 15:01:01.920368 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":367,"threads_started":1}
I20260808 15:01:01.922950 9222 heartbeater.cc:347] Connected to a master server at 127.12.73.190:36071
I20260808 15:01:01.923218 9222 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:01.923878 9222 heartbeater.cc:511] Master 127.12.73.190:36071 requested a full tablet report, sending...
I20260808 15:01:01.925360 8470 ts_manager.cc:194] Registered new tserver with Master: 17df93dd81a447a88ff361b6f87f5842 (127.12.73.131:43437)
I20260808 15:01:01.926119 8470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:40761
I20260808 15:01:01.930002 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:01:01.947100 9227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:01.934577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47456 (local address 127.12.73.190:36071)
0808 15:01:01.934749 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:01.934753 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:01.935271 (+ 518us) server_negotiation.cc:407] Connection header received
0808 15:01:01.935427 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:01.935431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:01.935514 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:01.935598 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:01.937073 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.937873 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.939251 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.939674 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.939764 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:01.942139 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:01.942144 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:01.942147 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:01.942178 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:01.944792 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:01.945489 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:01.945492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:01.945494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:01.945613 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:01.945918 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:01.945921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:01.945923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:01.946221 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:01.946402 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:01.946703 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 15:01:01.946889 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 15:01:01.950954 8470 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:01:01.958014 8470 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:01:01.982267 9257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:01.972426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46964 (local address 127.12.73.129:45331)
0808 15:01:01.973274 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:01.973285 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:01.973316 (+ 31us) server_negotiation.cc:407] Connection header received
0808 15:01:01.973440 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:01.973447 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:01.973699 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:01.973895 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:01.975766 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.977422 (+ 1656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.979589 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.981110 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.981283 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:01.981531 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:01.981752 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 15:01:01.981930 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":473,"threads_started":1}
I20260808 15:01:01.982213 9242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:01.970319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:45331 (local address 127.0.0.1:46964)
0808 15:01:01.972209 (+ 1890us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:01.972269 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:01.972463 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:01.975025 (+ 2562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:01.975031 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:01.975067 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:01.975553 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:01.975568 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.977560 (+ 1992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.977568 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:01.979396 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:01.979410 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.981360 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.981366 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:01.981579 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:01.981607 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 15:01:01.981689 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 15:01:01.981795 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1648,"mutex_wait_us":44,"thread_start_us":607,"threads_started":1}
I20260808 15:01:01.982470 9255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:01.971997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55126 (local address 127.12.73.130:35415)
0808 15:01:01.973651 (+ 1654us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:01.973660 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:01.973685 (+ 25us) server_negotiation.cc:407] Connection header received
0808 15:01:01.973788 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:01.973801 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:01.974023 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:01.974239 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:01.974968 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.976607 (+ 1639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.979509 (+ 2902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.980770 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.980925 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:01.981141 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:01.981972 (+ 831us) server_negotiation.cc:299] Negotiation successful
0808 15:01:01.982143 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1500,"thread_start_us":1383,"threads_started":1}
I20260808 15:01:01.983024 9249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:01.970510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:35415 (local address 127.0.0.1:55126)
0808 15:01:01.972590 (+ 2080us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:01.972606 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:01.972704 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:01.974217 (+ 1513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:01.974225 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:01.974256 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:01.974736 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:01.974752 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.976766 (+ 2014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.976772 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:01.979260 (+ 2488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:01.979272 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.980984 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.980990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:01.981323 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:01.981428 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 15:01:01.981569 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 15:01:01.981759 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1956,"mutex_wait_us":149,"thread_start_us":4497,"threads_started":1}
I20260808 15:01:01.984277 9247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:01.970963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:43437 (local address 127.0.0.1:55634)
0808 15:01:01.975308 (+ 4345us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:01.975322 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:01.975490 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:01.976474 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:01.976479 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:01.976504 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:01.976912 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:01.976927 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.978957 (+ 2030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.978963 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:01.981215 (+ 2252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:01.981231 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.983528 (+ 2297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.983534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:01.983712 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:01.983769 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 15:01:01.983862 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 15:01:01.983996 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4235,"mutex_wait_us":1,"thread_start_us":1341,"threads_started":1}
I20260808 15:01:01.984992 9254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:01.971689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55634 (local address 127.12.73.131:43437)
0808 15:01:01.974952 (+ 3263us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:01.974960 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:01.975445 (+ 485us) server_negotiation.cc:407] Connection header received
0808 15:01:01.975709 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:01.975718 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:01.975973 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:01.976167 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:01.977131 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.978786 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.981410 (+ 2624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:01.982939 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:01.983067 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:01.983332 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:01.984618 (+ 1286us) server_negotiation.cc:299] Negotiation successful
0808 15:01:01.984740 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3062,"thread_start_us":2903,"threads_started":1}
I20260808 15:01:01.986845 8894 tablet_service.cc:1467] Processing CreateTablet for tablet 5a748b64e5914a93902e3802a2a751af (DEFAULT_TABLE table=test-table [id=0283fe2207e243a1b2a36b9ed0a183f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:01.986856 8675 tablet_service.cc:1467] Processing CreateTablet for tablet 5a748b64e5914a93902e3802a2a751af (DEFAULT_TABLE table=test-table [id=0283fe2207e243a1b2a36b9ed0a183f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:01.988286 8675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a748b64e5914a93902e3802a2a751af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:01.988309 8894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a748b64e5914a93902e3802a2a751af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:01.988031 9118 tablet_service.cc:1467] Processing CreateTablet for tablet 5a748b64e5914a93902e3802a2a751af (DEFAULT_TABLE table=test-table [id=0283fe2207e243a1b2a36b9ed0a183f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:01.989251 9118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a748b64e5914a93902e3802a2a751af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:02.001037 9259 tablet_bootstrap.cc:492] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842: Bootstrap starting.
I20260808 15:01:02.003229 9260 tablet_bootstrap.cc:492] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9: Bootstrap starting.
I20260808 15:01:02.004081 9262 tablet_bootstrap.cc:492] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053: Bootstrap starting.
I20260808 15:01:02.006072 9259 tablet_bootstrap.cc:654] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:02.007424 9259 log.cc:824] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:02.008001 9262 tablet_bootstrap.cc:654] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:02.009281 9262 log.cc:824] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:02.010428 9259 tablet_bootstrap.cc:492] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842: No bootstrap required, opened a new log
I20260808 15:01:02.010725 9259 ts_tablet_manager.cc:1397] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 15:01:02.011668 9260 tablet_bootstrap.cc:654] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:02.012424 9262 tablet_bootstrap.cc:492] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053: No bootstrap required, opened a new log
I20260808 15:01:02.012771 9262 ts_tablet_manager.cc:1397] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 15:01:02.013386 9260 log.cc:824] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:02.016379 9260 tablet_bootstrap.cc:492] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9: No bootstrap required, opened a new log
I20260808 15:01:02.016636 9260 ts_tablet_manager.cc:1397] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260808 15:01:02.018652 9259 raft_consensus.cc:348] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da166410bf840dc9ef049fa613957b9" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45331 } } peers { permanent_uuid: "962f954dc7594d3783aee9c0632ba053" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35415 } } peers { permanent_uuid: "17df93dd81a447a88ff361b6f87f5842" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43437 } }
I20260808 15:01:02.019006 9259 raft_consensus.cc:374] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:02.019120 9259 raft_consensus.cc:729] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17df93dd81a447a88ff361b6f87f5842, State: Initialized, Role: FOLLOWER
I20260808 15:01:02.019718 9259 consensus_queue.cc:260] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da166410bf840dc9ef049fa613957b9" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45331 } } peers { permanent_uuid: "962f954dc7594d3783aee9c0632ba053" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35415 } } peers { permanent_uuid: "17df93dd81a447a88ff361b6f87f5842" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43437 } }
I20260808 15:01:02.020829 9222 heartbeater.cc:503] Master 127.12.73.190:36071 was elected leader, sending a full tablet report...
I20260808 15:01:02.021554 9259 ts_tablet_manager.cc:1428] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260808 15:01:02.023485 9262 raft_consensus.cc:348] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da166410bf840dc9ef049fa613957b9" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45331 } } peers { permanent_uuid: "962f954dc7594d3783aee9c0632ba053" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35415 } } peers { permanent_uuid: "17df93dd81a447a88ff361b6f87f5842" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43437 } }
I20260808 15:01:02.023972 9262 raft_consensus.cc:374] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:02.024127 9262 raft_consensus.cc:729] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 962f954dc7594d3783aee9c0632ba053, State: Initialized, Role: FOLLOWER
I20260808 15:01:02.024775 9262 consensus_queue.cc:260] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da166410bf840dc9ef049fa613957b9" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45331 } } peers { permanent_uuid: "962f954dc7594d3783aee9c0632ba053" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35415 } } peers { permanent_uuid: "17df93dd81a447a88ff361b6f87f5842" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43437 } }
I20260808 15:01:02.025876 8999 heartbeater.cc:503] Master 127.12.73.190:36071 was elected leader, sending a full tablet report...
I20260808 15:01:02.026592 9262 ts_tablet_manager.cc:1428] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260808 15:01:02.028390 9260 raft_consensus.cc:348] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da166410bf840dc9ef049fa613957b9" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45331 } } peers { permanent_uuid: "962f954dc7594d3783aee9c0632ba053" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35415 } } peers { permanent_uuid: "17df93dd81a447a88ff361b6f87f5842" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43437 } }
I20260808 15:01:02.028828 9260 raft_consensus.cc:374] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:02.028939 9260 raft_consensus.cc:729] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3da166410bf840dc9ef049fa613957b9, State: Initialized, Role: FOLLOWER
I20260808 15:01:02.029541 9260 consensus_queue.cc:260] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da166410bf840dc9ef049fa613957b9" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45331 } } peers { permanent_uuid: "962f954dc7594d3783aee9c0632ba053" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35415 } } peers { permanent_uuid: "17df93dd81a447a88ff361b6f87f5842" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43437 } }
I20260808 15:01:02.031045 9260 ts_tablet_manager.cc:1428] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
W20260808 15:01:02.044543 8783 tablet.cc:2369] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:01:02.107010 9001 tablet.cc:2369] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:01:02.127812 9269 raft_consensus.cc:482] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:01:02.128144 9269 raft_consensus.cc:504] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da166410bf840dc9ef049fa613957b9" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45331 } } peers { permanent_uuid: "962f954dc7594d3783aee9c0632ba053" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35415 } } peers { permanent_uuid: "17df93dd81a447a88ff361b6f87f5842" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43437 } }
I20260808 15:01:02.129992 9269 leader_election.cc:288] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3da166410bf840dc9ef049fa613957b9 (127.12.73.129:45331), 17df93dd81a447a88ff361b6f87f5842 (127.12.73.131:43437)
I20260808 15:01:02.137430 9257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:02.130406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:42279 (local address 127.12.73.129:45331)
0808 15:01:02.130665 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:02.130674 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:02.131716 (+ 1042us) server_negotiation.cc:407] Connection header received
0808 15:01:02.131910 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:02.131916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:02.131991 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:02.132093 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:02.132850 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.133829 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.135606 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.136373 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.136496 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:02.136547 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:02.136980 (+ 433us) server_negotiation.cc:299] Negotiation successful
0808 15:01:02.137130 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 15:01:02.137461 9254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:02.130554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:46079 (local address 127.12.73.131:43437)
0808 15:01:02.130814 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:02.130823 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:02.131438 (+ 615us) server_negotiation.cc:407] Connection header received
0808 15:01:02.131727 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:02.131734 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:02.131822 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:02.131922 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:02.132675 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.133664 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.135532 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.136501 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.136666 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:02.136744 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:02.137037 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 15:01:02.137202 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 15:01:02.137485 9276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:02.130415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:45331 (local address 127.12.73.130:42279)
0808 15:01:02.131572 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:02.131588 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:02.131755 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:02.132122 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:02.132129 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:02.132162 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:02.132663 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:02.132676 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.133984 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.133988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:02.135418 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:02.135430 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.136597 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.136604 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:02.136806 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:02.136841 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 15:01:02.136916 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 15:01:02.137055 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1040,"thread_start_us":628,"threads_started":1}
I20260808 15:01:02.137601 9274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:02.130288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:43437 (local address 127.12.73.130:46079)
0808 15:01:02.131287 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:02.131303 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:02.131556 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:02.131946 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:02.131950 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:02.131976 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:02.132506 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:02.132552 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.133772 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.133780 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:02.135376 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:02.135388 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.136729 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.136734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:02.136852 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:02.136875 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:01:02.136990 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 15:01:02.137147 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"mutex_wait_us":5,"spinlock_wait_cycles":23808,"thread_start_us":600,"threads_started":1}
I20260808 15:01:02.138550 9149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a748b64e5914a93902e3802a2a751af" candidate_uuid: "962f954dc7594d3783aee9c0632ba053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17df93dd81a447a88ff361b6f87f5842" is_pre_election: true
I20260808 15:01:02.138765 8718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a748b64e5914a93902e3802a2a751af" candidate_uuid: "962f954dc7594d3783aee9c0632ba053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3da166410bf840dc9ef049fa613957b9" is_pre_election: true
I20260808 15:01:02.139151 9149 raft_consensus.cc:2454] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 962f954dc7594d3783aee9c0632ba053 in term 0.
I20260808 15:01:02.139262 8718 raft_consensus.cc:2454] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 962f954dc7594d3783aee9c0632ba053 in term 0.
I20260808 15:01:02.139931 8821 leader_election.cc:302] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 17df93dd81a447a88ff361b6f87f5842, 3da166410bf840dc9ef049fa613957b9, 962f954dc7594d3783aee9c0632ba053; no voters:
I20260808 15:01:02.140372 9269 raft_consensus.cc:2781] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:01:02.140527 9269 raft_consensus.cc:482] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:01:02.140648 9269 raft_consensus.cc:3037] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:02.142925 9269 raft_consensus.cc:504] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da166410bf840dc9ef049fa613957b9" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45331 } } peers { permanent_uuid: "962f954dc7594d3783aee9c0632ba053" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35415 } } peers { permanent_uuid: "17df93dd81a447a88ff361b6f87f5842" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43437 } }
I20260808 15:01:02.143592 9269 leader_election.cc:288] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [CANDIDATE]: Term 1 election: Requested vote from peers 3da166410bf840dc9ef049fa613957b9 (127.12.73.129:45331), 17df93dd81a447a88ff361b6f87f5842 (127.12.73.131:43437)
I20260808 15:01:02.144004 8718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a748b64e5914a93902e3802a2a751af" candidate_uuid: "962f954dc7594d3783aee9c0632ba053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3da166410bf840dc9ef049fa613957b9"
I20260808 15:01:02.144083 9149 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a748b64e5914a93902e3802a2a751af" candidate_uuid: "962f954dc7594d3783aee9c0632ba053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17df93dd81a447a88ff361b6f87f5842"
I20260808 15:01:02.144197 8718 raft_consensus.cc:3037] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:02.144317 9149 raft_consensus.cc:3037] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:02.146509 8718 raft_consensus.cc:2454] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 962f954dc7594d3783aee9c0632ba053 in term 1.
I20260808 15:01:02.146585 9149 raft_consensus.cc:2454] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 962f954dc7594d3783aee9c0632ba053 in term 1.
I20260808 15:01:02.146955 8816 leader_election.cc:302] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3da166410bf840dc9ef049fa613957b9, 962f954dc7594d3783aee9c0632ba053; no voters:
I20260808 15:01:02.147270 9269 raft_consensus.cc:2781] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:02.147709 9269 raft_consensus.cc:686] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 1 LEADER]: Becoming Leader. State: Replica: 962f954dc7594d3783aee9c0632ba053, State: Running, Role: LEADER
I20260808 15:01:02.148249 9269 consensus_queue.cc:237] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da166410bf840dc9ef049fa613957b9" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45331 } } peers { permanent_uuid: "962f954dc7594d3783aee9c0632ba053" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35415 } } peers { permanent_uuid: "17df93dd81a447a88ff361b6f87f5842" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43437 } }
W20260808 15:01:02.151768 9225 tablet.cc:2369] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:01:02.153445 8470 catalog_manager.cc:5495] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 reported cstate change: term changed from 0 to 1, leader changed from <none> to 962f954dc7594d3783aee9c0632ba053 (127.12.73.130). New cstate: current_term: 1 leader_uuid: "962f954dc7594d3783aee9c0632ba053" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3da166410bf840dc9ef049fa613957b9" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "962f954dc7594d3783aee9c0632ba053" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 35415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17df93dd81a447a88ff361b6f87f5842" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43437 } health_report { overall_health: UNKNOWN } } }
I20260808 15:01:02.175676 9255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:02.170253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55142 (local address 127.12.73.130:35415)
0808 15:01:02.170492 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:02.170499 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:02.170594 (+ 95us) server_negotiation.cc:407] Connection header received
0808 15:01:02.170836 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:02.170840 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:02.170923 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:02.171074 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:01:02.171443 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.172148 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.173565 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.173955 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.174086 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:02.174557 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:01:02.175056 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:01:02.175213 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:02.175319 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 15:01:02.175399 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 15:01:02.183481 9149 raft_consensus.cc:1261] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842 [term 1 FOLLOWER]: Refusing update from remote peer 962f954dc7594d3783aee9c0632ba053: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:01:02.183645 8718 raft_consensus.cc:1261] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9 [term 1 FOLLOWER]: Refusing update from remote peer 962f954dc7594d3783aee9c0632ba053: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:01:02.184556 9280 consensus_queue.cc:1035] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3da166410bf840dc9ef049fa613957b9" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:01:02.184875 9269 consensus_queue.cc:1035] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17df93dd81a447a88ff361b6f87f5842" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:01:02.195953 9285 mvcc.cc:205] Tried to move back new op lower bound from 7316280369893646336 to 7316280369763713024. Current Snapshot: MvccSnapshot[applied={T|T < 7316280369893646336}]
I20260808 15:01:02.208477 8469 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:01:02.208755 8469 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:01:02.212467 8469 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a285de5c24648dd8a810ec0a923fb0e: Sending DeleteTablet for 3 replicas of tablet 5a748b64e5914a93902e3802a2a751af
I20260808 15:01:02.213590 8675 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a748b64e5914a93902e3802a2a751af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:02 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:46964
I20260808 15:01:02.213742 8894 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a748b64e5914a93902e3802a2a751af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:02 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:55126
I20260808 15:01:02.214692 9118 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a748b64e5914a93902e3802a2a751af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:02 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:55634
I20260808 15:01:02.215018 9302 tablet_replica.cc:330] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9: stopping tablet replica
I20260808 15:01:02.215215 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 8578
I20260808 15:01:02.215606 9302 raft_consensus.cc:2229] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:01:02.216230 9302 raft_consensus.cc:2258] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:02.221781 9302 ts_tablet_manager.cc:1905] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:02.224897 9306 tablet_replica.cc:330] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842: stopping tablet replica
I20260808 15:01:02.225605 9306 raft_consensus.cc:2229] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:01:02.226328 9306 raft_consensus.cc:2258] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:02.227305 9304 tablet_replica.cc:330] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053: stopping tablet replica
I20260808 15:01:02.229449 9306 ts_tablet_manager.cc:1905] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:02.229975 9304 raft_consensus.cc:2229] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:01:02.231120 9302 ts_tablet_manager.cc:1918] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:02.231294 9302 log.cc:1196] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/5a748b64e5914a93902e3802a2a751af
I20260808 15:01:02.231887 9302 ts_tablet_manager.cc:1939] T 5a748b64e5914a93902e3802a2a751af P 3da166410bf840dc9ef049fa613957b9: Deleting consensus metadata
I20260808 15:01:02.232056 9304 raft_consensus.cc:2258] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:02.234051 8446 catalog_manager.cc:4841] TS 3da166410bf840dc9ef049fa613957b9 (127.12.73.129:45331): tablet 5a748b64e5914a93902e3802a2a751af (table test-table [id=0283fe2207e243a1b2a36b9ed0a183f7]) successfully deleted
I20260808 15:01:02.236075 9304 ts_tablet_manager.cc:1905] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:02.239319 9306 ts_tablet_manager.cc:1918] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:02.239478 9306 log.cc:1196] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/5a748b64e5914a93902e3802a2a751af
Aug 08 15:01:02 dist-test-slave-z8x9 krb5kdc[8397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 15:01:02.240060 9306 ts_tablet_manager.cc:1939] T 5a748b64e5914a93902e3802a2a751af P 17df93dd81a447a88ff361b6f87f5842: Deleting consensus metadata
I20260808 15:01:02.241990 8451 catalog_manager.cc:4841] TS 17df93dd81a447a88ff361b6f87f5842 (127.12.73.131:43437): tablet 5a748b64e5914a93902e3802a2a751af (table test-table [id=0283fe2207e243a1b2a36b9ed0a183f7]) successfully deleted
I20260808 15:01:02.243240 9304 ts_tablet_manager.cc:1918] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:02.243440 9304 log.cc:1196] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/5a748b64e5914a93902e3802a2a751af
I20260808 15:01:02.243914 9304 ts_tablet_manager.cc:1939] T 5a748b64e5914a93902e3802a2a751af P 962f954dc7594d3783aee9c0632ba053: Deleting consensus metadata
I20260808 15:01:02.245357 8447 catalog_manager.cc:4841] TS 962f954dc7594d3783aee9c0632ba053 (127.12.73.130:35415): tablet 5a748b64e5914a93902e3802a2a751af (table test-table [id=0283fe2207e243a1b2a36b9ed0a183f7]) successfully deleted
I20260808 15:01:02.248479 9257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:02.216900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46970 (local address 127.12.73.129:45331)
0808 15:01:02.217137 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:02.217146 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:02.227405 (+ 10259us) server_negotiation.cc:407] Connection header received
0808 15:01:02.227905 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:02.227914 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:02.228003 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:02.228092 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:02.230018 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.231137 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.233231 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.233862 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.233973 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:02.241217 (+ 7244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:02.241235 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:02.241256 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:02.241308 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:02.245538 (+ 4230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:02.246268 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:02.246278 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:02.246282 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:02.246454 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:02.246829 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:02.246845 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:02.246849 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:02.247337 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:02.247643 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:02.247861 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 15:01:02.248088 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 15:01:02.249217 8775 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:02.339918 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 8578
I20260808 15:01:02.375361 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 8788
Aug 08 15:01:02 dist-test-slave-z8x9 krb5kdc[8397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 15:01:02.392824 9255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:02.376157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33502 (local address 127.12.73.130:35415)
0808 15:01:02.376351 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:02.376358 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:02.376440 (+ 82us) server_negotiation.cc:407] Connection header received
0808 15:01:02.376589 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:02.376599 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:02.376684 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:02.376787 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:02.378250 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.379492 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.380891 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.381595 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.381730 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:02.386359 (+ 4629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:02.386374 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:02.386389 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:02.386432 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:02.389754 (+ 3322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:02.390487 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:02.390503 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:02.390506 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:02.390679 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:02.391097 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:02.391103 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:02.391106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:02.391583 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:02.391945 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:02.392221 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 15:01:02.392456 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 15:01:02.393740 8992 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:02.512320 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 8788
I20260808 15:01:02.542573 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 9011
Aug 08 15:01:02 dist-test-slave-z8x9 krb5kdc[8397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 15:01:02.557955 9254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:02.543514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42008 (local address 127.12.73.131:43437)
0808 15:01:02.543682 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:02.543687 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:02.543706 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:01:02.543764 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:02.543768 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:02.543833 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:02.543921 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:02.545337 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.546059 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.547310 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:02.547691 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:02.547792 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:02.552485 (+ 4693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:02.552501 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:02.552518 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:02.552553 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:02.555294 (+ 2741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:02.556016 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:02.556028 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:02.556031 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:02.556236 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:02.556586 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:02.556590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:02.556592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:02.556958 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:02.557309 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:02.557501 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 15:01:02.557679 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:01:02.558655 9211 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:02.648850 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 9011
I20260808 15:01:02.673106 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 8417
I20260808 15:01:02.674322 8530 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:02.807534 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 8417
2026-08-08T15:01:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4810 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T15:01:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:02Z Disabled control of system clock
I20260808 15:01:02.907797 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:43513
--webserver_interface=127.12.73.190
--webserver_port=0
--builtin_ntp_servers=127.12.73.148:42011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:43513
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 15:01:03.242729 9321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:03.243103 9321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:03.243260 9321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:03.250671 9321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:03.250828 9321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:03.250921 9321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:03.251035 9321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:03.251120 9321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:03.261317 9321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:42011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:43513
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:43513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:03.262714 9321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:03.264499 9321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:03.275931 9334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:03.275974 9336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:03.276201 9332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:03.277036 9321 server_base.cc:1034] running on GCE node
I20260808 15:01:03.277922 9321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:03.279289 9321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:03.280493 9321 hybrid_clock.cc:648] HybridClock initialized: now 1786201263280448 us; error 30 us; skew 500 ppm
I20260808 15:01:03.280802 9321 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 15:01:03.287595 9321 webserver.cc:460] Webserver started at http://127.12.73.190:33863/ using document root <none> and password file <none>
I20260808 15:01:03.288280 9321 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:03.288372 9321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:03.288647 9321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:03.291594 9321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "6e58013bda9c484c8412ea8fcec100dd"
format_stamp: "Formatted at 2026-08-08 15:01:03 on dist-test-slave-z8x9"
server_key: "f7ef07556aea77485847737dac0bc935"
server_key_iv: "7bb408891d128ed0aeec6aaae78ffa6e"
server_key_version: "encryptionkey@0"
I20260808 15:01:03.292390 9321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "6e58013bda9c484c8412ea8fcec100dd"
format_stamp: "Formatted at 2026-08-08 15:01:03 on dist-test-slave-z8x9"
server_key: "f7ef07556aea77485847737dac0bc935"
server_key_iv: "7bb408891d128ed0aeec6aaae78ffa6e"
server_key_version: "encryptionkey@0"
I20260808 15:01:03.297629 9321 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 15:01:03.300884 9344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:03.302296 9321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:01:03.302490 9321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "6e58013bda9c484c8412ea8fcec100dd"
format_stamp: "Formatted at 2026-08-08 15:01:03 on dist-test-slave-z8x9"
server_key: "f7ef07556aea77485847737dac0bc935"
server_key_iv: "7bb408891d128ed0aeec6aaae78ffa6e"
server_key_version: "encryptionkey@0"
I20260808 15:01:03.302726 9321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:03.318993 9321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:03.319780 9321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:03.320068 9321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:03.338608 9321 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:43513
I20260808 15:01:03.338642 9436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:43513 every 8 connection(s)
I20260808 15:01:03.340000 9321 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:03.343637 9438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:03.344092 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 9321
I20260808 15:01:03.344281 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:03.344750 12582 external_mini_cluster.cc:1428] Setting key ddc52d7f40c05d62726d59578621e31f
I20260808 15:01:03.356052 9438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd: Bootstrap starting.
I20260808 15:01:03.358589 9444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:03.346687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58866 (local address 127.12.73.190:43513)
0808 15:01:03.347729 (+ 1042us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:03.347739 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:03.347782 (+ 43us) server_negotiation.cc:407] Connection header received
0808 15:01:03.349937 (+ 2155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:03.349960 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:03.350437 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:03.350829 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:03.351372 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:03.352599 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:03.354077 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:03.354744 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:03.354943 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:03.356254 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:03.356263 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:03.356277 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:03.356787 (+ 510us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:03.356861 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:03.356883 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:03.357016 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:03.357282 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 15:01:03.357599 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":389,"threads_started":1}
I20260808 15:01:03.359442 9438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:03.360455 9438 log.cc:824] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:03.363076 9438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd: No bootstrap required, opened a new log
I20260808 15:01:03.369992 9438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e58013bda9c484c8412ea8fcec100dd" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43513 } }
I20260808 15:01:03.370362 9438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:03.370473 9438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e58013bda9c484c8412ea8fcec100dd, State: Initialized, Role: FOLLOWER
I20260808 15:01:03.370992 9438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e58013bda9c484c8412ea8fcec100dd" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43513 } }
I20260808 15:01:03.371234 9438 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:03.371383 9438 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:03.371572 9438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:03.373805 9438 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e58013bda9c484c8412ea8fcec100dd" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43513 } }
I20260808 15:01:03.374270 9438 leader_election.cc:302] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e58013bda9c484c8412ea8fcec100dd; no voters:
I20260808 15:01:03.374846 9438 leader_election.cc:288] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:03.374987 9448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:03.375769 9448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [term 1 LEADER]: Becoming Leader. State: Replica: 6e58013bda9c484c8412ea8fcec100dd, State: Running, Role: LEADER
I20260808 15:01:03.376238 9448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e58013bda9c484c8412ea8fcec100dd" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43513 } }
I20260808 15:01:03.376865 9438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:03.379020 9450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e58013bda9c484c8412ea8fcec100dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e58013bda9c484c8412ea8fcec100dd" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43513 } } }
I20260808 15:01:03.379491 9450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:03.379136 9452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e58013bda9c484c8412ea8fcec100dd. Latest consensus state: current_term: 1 leader_uuid: "6e58013bda9c484c8412ea8fcec100dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e58013bda9c484c8412ea8fcec100dd" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43513 } } }
I20260808 15:01:03.384836 9452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:03.386312 9463 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:03.391213 9463 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:03.399710 9463 catalog_manager.cc:1347] Generated new cluster ID: 7a48ff6262f54bcaa99fbce35d804827
I20260808 15:01:03.399820 9463 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:03.413076 9463 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:03.414827 9463 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:03.423374 9463 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd: Generated new TSK 0
I20260808 15:01:03.424155 9463 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:03.431620 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43513
--builtin_ntp_servers=127.12.73.148:42011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 15:01:03.774222 9483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:03.774495 9483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:03.774663 9483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:03.782018 9483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:03.782138 9483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:03.782326 9483 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 15:01:03.791347 9483 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:42011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43513
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:03.792671 9483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:03.794593 9483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:03.808310 9490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:03.808367 9495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:03.808393 9489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:03.809509 9483 server_base.cc:1034] running on GCE node
I20260808 15:01:03.810105 9483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:03.811136 9483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:03.812410 9483 hybrid_clock.cc:648] HybridClock initialized: now 1786201263812363 us; error 61 us; skew 500 ppm
I20260808 15:01:03.812762 9483 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 15:01:03.815344 9483 webserver.cc:460] Webserver started at http://127.12.73.129:39203/ using document root <none> and password file <none>
I20260808 15:01:03.816058 9483 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:03.816207 9483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:03.816543 9483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:03.819615 9483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "0694d59eddf44e7bb5eefb3253f77cf7"
format_stamp: "Formatted at 2026-08-08 15:01:03 on dist-test-slave-z8x9"
server_key: "58156ff3674508281293062612cc15d9"
server_key_iv: "f1634e0ca828090d106335e554da6e96"
server_key_version: "encryptionkey@0"
I20260808 15:01:03.820454 9483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "0694d59eddf44e7bb5eefb3253f77cf7"
format_stamp: "Formatted at 2026-08-08 15:01:03 on dist-test-slave-z8x9"
server_key: "58156ff3674508281293062612cc15d9"
server_key_iv: "f1634e0ca828090d106335e554da6e96"
server_key_version: "encryptionkey@0"
I20260808 15:01:03.825865 9483 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260808 15:01:03.829481 9505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:03.830729 9483 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:01:03.830912 9483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "0694d59eddf44e7bb5eefb3253f77cf7"
format_stamp: "Formatted at 2026-08-08 15:01:03 on dist-test-slave-z8x9"
server_key: "58156ff3674508281293062612cc15d9"
server_key_iv: "f1634e0ca828090d106335e554da6e96"
server_key_version: "encryptionkey@0"
I20260808 15:01:03.831137 9483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:03.850091 9483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:03.850970 9483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:03.851312 9483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:03.852305 9483 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:03.853828 9483 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:03.853971 9483 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:03.854110 9483 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:03.854204 9483 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:03.889670 9483 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:38821
I20260808 15:01:03.889761 9711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:38821 every 8 connection(s)
I20260808 15:01:03.891047 9483 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 15:01:03.894671 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 9483
I20260808 15:01:03.894886 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 15:01:03.895488 12582 external_mini_cluster.cc:1428] Setting key 723f45d94d6f220238b92c0c38e63ff3
I20260808 15:01:03.898679 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43513
--builtin_ntp_servers=127.12.73.148:42011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 15:01:03.905967 9719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:03.893701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:55727 (local address 127.12.73.190:43513)
0808 15:01:03.894155 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:03.894163 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:03.895559 (+ 1396us) server_negotiation.cc:407] Connection header received
0808 15:01:03.897739 (+ 2180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:03.897743 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:03.897805 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:03.897897 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:03.899306 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:03.900016 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:03.902512 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:03.903175 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:03.903303 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:03.904979 (+ 1676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:03.904988 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:03.904995 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:03.905019 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:03.905073 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:03.905089 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:03.905208 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:03.905456 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 15:01:03.905557 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":216,"threads_started":1}
I20260808 15:01:03.907313 9721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:03.894260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:43513 (local address 127.12.73.129:55727)
0808 15:01:03.895373 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:03.895419 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:03.897417 (+ 1998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:03.898166 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:03.898177 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:03.898294 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:03.899132 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:03.899161 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:03.900177 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:03.900185 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:03.902363 (+ 2178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:03.902382 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:03.903412 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:03.903422 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:03.903757 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:03.904600 (+ 843us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:01:03.904606 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:03.904658 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:01:03.904769 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:03.905220 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:03.905235 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:03.905247 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 15:01:03.905433 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 15:01:03.905863 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":311,"threads_started":1}
I20260808 15:01:03.908882 9715 heartbeater.cc:347] Connected to a master server at 127.12.73.190:43513
I20260808 15:01:03.909228 9715 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:03.910156 9715 heartbeater.cc:511] Master 127.12.73.190:43513 requested a full tablet report, sending...
I20260808 15:01:03.912489 9374 ts_manager.cc:194] Registered new tserver with Master: 0694d59eddf44e7bb5eefb3253f77cf7 (127.12.73.129:38821)
I20260808 15:01:03.914654 9374 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.73.129:55727
W20260808 15:01:04.243309 9722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:04.243592 9722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:04.243680 9722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:04.250815 9722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:04.250917 9722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:04.251024 9722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 15:01:04.260061 9722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:42011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43513
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:04.261407 9722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:04.263227 9722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:04.276405 9731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:04.276396 9738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:04.276393 9733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:04.277268 9722 server_base.cc:1034] running on GCE node
I20260808 15:01:04.277925 9722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:04.278985 9722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:04.280193 9722 hybrid_clock.cc:648] HybridClock initialized: now 1786201264280150 us; error 30 us; skew 500 ppm
I20260808 15:01:04.280548 9722 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 15:01:04.282955 9722 webserver.cc:460] Webserver started at http://127.12.73.130:38881/ using document root <none> and password file <none>
I20260808 15:01:04.283661 9722 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:04.283783 9722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:04.284129 9722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:04.287102 9722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "42b289cc4597443684724bb64c66f774"
format_stamp: "Formatted at 2026-08-08 15:01:04 on dist-test-slave-z8x9"
server_key: "9ec594f4d0abbf1bc79325b408f3db84"
server_key_iv: "6f87d31b2cbcf62d3913a69e689a7853"
server_key_version: "encryptionkey@0"
I20260808 15:01:04.287943 9722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "42b289cc4597443684724bb64c66f774"
format_stamp: "Formatted at 2026-08-08 15:01:04 on dist-test-slave-z8x9"
server_key: "9ec594f4d0abbf1bc79325b408f3db84"
server_key_iv: "6f87d31b2cbcf62d3913a69e689a7853"
server_key_version: "encryptionkey@0"
I20260808 15:01:04.293417 9722 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 15:01:04.296869 9751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:04.298270 9722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:01:04.298462 9722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "42b289cc4597443684724bb64c66f774"
format_stamp: "Formatted at 2026-08-08 15:01:04 on dist-test-slave-z8x9"
server_key: "9ec594f4d0abbf1bc79325b408f3db84"
server_key_iv: "6f87d31b2cbcf62d3913a69e689a7853"
server_key_version: "encryptionkey@0"
I20260808 15:01:04.298686 9722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:04.319023 9722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:04.319857 9722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:04.320194 9722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:04.321231 9722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:04.322721 9722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:04.322860 9722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:04.322988 9722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:04.323078 9722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:04.358763 9722 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:38273
I20260808 15:01:04.358867 9960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:38273 every 8 connection(s)
I20260808 15:01:04.360147 9722 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 15:01:04.362548 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 9722
I20260808 15:01:04.362748 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 15:01:04.363312 12582 external_mini_cluster.cc:1428] Setting key b4efbedefa819531edb90f9e22d9f1ae
I20260808 15:01:04.366672 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43513
--builtin_ntp_servers=127.12.73.148:42011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 15:01:04.375576 9719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:04.363193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:38919 (local address 127.12.73.190:43513)
0808 15:01:04.363451 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:04.363458 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:04.365005 (+ 1547us) server_negotiation.cc:407] Connection header received
0808 15:01:04.367651 (+ 2646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:04.367656 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:04.367727 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:04.367821 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:04.369303 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.370074 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.372522 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.372952 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.373077 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:04.374801 (+ 1724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:04.374807 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:04.374811 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:04.374832 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:04.374865 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:04.374878 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:04.374954 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:04.375241 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 15:01:04.375324 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260808 15:01:04.377003 9967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:04.363775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:43513 (local address 127.12.73.130:38919)
0808 15:01:04.364842 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:04.364889 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:04.367357 (+ 2468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:04.368079 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:04.368093 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:04.368208 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:04.369049 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:04.369077 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.370242 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.370250 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:04.372366 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:04.372383 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.373224 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.373235 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:04.373587 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:04.374421 (+ 834us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:01:04.374427 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:04.374482 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:01:04.374595 (+ 113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:04.374983 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:04.374996 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:04.375007 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 15:01:04.375182 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 15:01:04.375607 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":354,"threads_started":1}
I20260808 15:01:04.378650 9962 heartbeater.cc:347] Connected to a master server at 127.12.73.190:43513
I20260808 15:01:04.379002 9962 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:04.380034 9962 heartbeater.cc:511] Master 127.12.73.190:43513 requested a full tablet report, sending...
I20260808 15:01:04.381775 9374 ts_manager.cc:194] Registered new tserver with Master: 42b289cc4597443684724bb64c66f774 (127.12.73.130:38273)
I20260808 15:01:04.383075 9374 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.73.130:38919
W20260808 15:01:04.716817 9968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:04.717101 9968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:04.717288 9968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:04.724586 9968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:04.724686 9968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:04.724804 9968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 15:01:04.733994 9968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:42011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43513
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:04.735386 9968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:04.737325 9968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:04.750504 9976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:04.750540 9975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:04.750473 9983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:04.751878 9968 server_base.cc:1034] running on GCE node
I20260808 15:01:04.752518 9968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:04.753530 9968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:04.754760 9968 hybrid_clock.cc:648] HybridClock initialized: now 1786201264754707 us; error 44 us; skew 500 ppm
I20260808 15:01:04.755118 9968 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 15:01:04.757791 9968 webserver.cc:460] Webserver started at http://127.12.73.131:41605/ using document root <none> and password file <none>
I20260808 15:01:04.758535 9968 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:04.758670 9968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:04.759014 9968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:04.762305 9968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "2845f479ad5547c19c63ca689b9f72ce"
format_stamp: "Formatted at 2026-08-08 15:01:04 on dist-test-slave-z8x9"
server_key: "d402fa2e4a6519574dd2c314cf28e841"
server_key_iv: "4358a2b7e56252ef1d0184ab941aa575"
server_key_version: "encryptionkey@0"
I20260808 15:01:04.763154 9968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "2845f479ad5547c19c63ca689b9f72ce"
format_stamp: "Formatted at 2026-08-08 15:01:04 on dist-test-slave-z8x9"
server_key: "d402fa2e4a6519574dd2c314cf28e841"
server_key_iv: "4358a2b7e56252ef1d0184ab941aa575"
server_key_version: "encryptionkey@0"
I20260808 15:01:04.768430 9968 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260808 15:01:04.772133 9993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:04.773556 9968 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:01:04.773762 9968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "2845f479ad5547c19c63ca689b9f72ce"
format_stamp: "Formatted at 2026-08-08 15:01:04 on dist-test-slave-z8x9"
server_key: "d402fa2e4a6519574dd2c314cf28e841"
server_key_iv: "4358a2b7e56252ef1d0184ab941aa575"
server_key_version: "encryptionkey@0"
I20260808 15:01:04.773981 9968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:04.800213 9968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:04.801265 9968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:04.801584 9968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:04.802750 9968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:04.804632 9968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:04.804767 9968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:04.804904 9968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:04.805001 9968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:04.839344 9968 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:43389
I20260808 15:01:04.839439 10203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:43389 every 8 connection(s)
I20260808 15:01:04.840714 9968 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 15:01:04.841965 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 9968
I20260808 15:01:04.842150 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 15:01:04.842703 12582 external_mini_cluster.cc:1428] Setting key fe28d004604f337d67f8e93ee502c26b
I20260808 15:01:04.853899 9719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:04.843532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:58155 (local address 127.12.73.190:43513)
0808 15:01:04.843716 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:04.843725 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:04.845436 (+ 1711us) server_negotiation.cc:407] Connection header received
0808 15:01:04.847438 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:04.847443 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:04.847532 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:04.847648 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:04.848712 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.849550 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.851103 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.851514 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.851651 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:04.853009 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:04.853014 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:04.853017 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:04.853036 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:04.853068 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:04.853080 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:04.853172 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:04.853482 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 15:01:04.853597 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:01:04.854872 10213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:04.844184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:43513 (local address 127.12.73.131:58155)
0808 15:01:04.845287 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:04.845332 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:04.847175 (+ 1843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:04.847895 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:04.847902 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:04.847986 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:04.848544 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:04.848560 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.849696 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.849701 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:04.850949 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:04.850962 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.851742 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.851749 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:04.851987 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:04.852680 (+ 693us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:01:04.852682 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:04.852724 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:01:04.852799 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:04.853210 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:04.853227 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:04.853233 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:01:04.853431 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 15:01:04.853746 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":308,"threads_started":1}
I20260808 15:01:04.856388 10206 heartbeater.cc:347] Connected to a master server at 127.12.73.190:43513
I20260808 15:01:04.856724 10206 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:04.857662 10206 heartbeater.cc:511] Master 127.12.73.190:43513 requested a full tablet report, sending...
I20260808 15:01:04.859144 9374 ts_manager.cc:194] Registered new tserver with Master: 2845f479ad5547c19c63ca689b9f72ce (127.12.73.131:43389)
I20260808 15:01:04.859941 9374 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.73.131:58155
I20260808 15:01:04.871132 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:01:04.882375 9719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:04.875763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58868 (local address 127.12.73.190:43513)
0808 15:01:04.876018 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:04.876028 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:04.876499 (+ 471us) server_negotiation.cc:407] Connection header received
0808 15:01:04.876722 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:04.876728 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:04.876851 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:04.876959 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:04.877589 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.878486 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.879990 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.880385 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.880481 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:04.881649 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:04.881654 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:04.881658 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:04.881675 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:04.881709 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:04.881720 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:04.881792 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:04.881959 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 15:01:04.882035 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:01:04.886113 9374 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:01:04.892978 9374 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:01:04.915591 10238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:04.904837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38821 (local address 127.0.0.1:42528)
0808 15:01:04.905915 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:04.905967 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:04.906181 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:04.907390 (+ 1209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:04.907399 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:04.907429 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:04.908845 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:04.908859 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.910809 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.910814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:04.913139 (+ 2325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:04.913151 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.914574 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.914580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:04.914812 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:04.914881 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 15:01:04.915015 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 15:01:04.915222 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":801,"mutex_wait_us":33,"thread_start_us":632,"threads_started":1}
I20260808 15:01:04.915630 10240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:04.905304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42528 (local address 127.12.73.129:38821)
0808 15:01:04.906783 (+ 1479us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:04.906792 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:04.906824 (+ 32us) server_negotiation.cc:407] Connection header received
0808 15:01:04.906927 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:04.906933 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:04.907107 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:04.907318 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:04.909088 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.910669 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.913386 (+ 2717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.914400 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.914539 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:04.914831 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:04.915078 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 15:01:04.915256 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1313,"thread_start_us":1185,"threads_started":1}
I20260808 15:01:04.917089 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:04.905108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:38273 (local address 127.0.0.1:47070)
0808 15:01:04.908294 (+ 3186us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:04.908316 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:04.908458 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:04.909397 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:04.909401 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:04.909427 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:04.909775 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:04.909784 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.911599 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.911604 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:04.914121 (+ 2517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:04.914137 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.916278 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.916285 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:04.916444 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:04.916476 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 15:01:04.916549 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 15:01:04.916677 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3011,"mutex_wait_us":54,"thread_start_us":2824,"threads_started":1}
I20260808 15:01:04.918170 9715 heartbeater.cc:503] Master 127.12.73.190:43513 was elected leader, sending a full tablet report...
I20260808 15:01:04.918329 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:04.907858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:43389 (local address 127.0.0.1:37422)
0808 15:01:04.908597 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:04.908617 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:04.908756 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:04.910049 (+ 1293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:04.910057 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:04.910085 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:04.910441 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:04.910453 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.912058 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.912063 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:04.914306 (+ 2243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:04.914319 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.917467 (+ 3148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.917474 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:04.917665 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:04.917716 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 15:01:04.917811 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 15:01:04.917948 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"mutex_wait_us":1,"thread_start_us":453,"threads_started":1}
I20260808 15:01:04.919028 10244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:04.907995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37422 (local address 127.12.73.131:43389)
0808 15:01:04.909444 (+ 1449us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:04.909452 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:04.909485 (+ 33us) server_negotiation.cc:407] Connection header received
0808 15:01:04.909585 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:04.909592 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:04.909809 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:04.910037 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:04.910646 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.911843 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.914491 (+ 2648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.916811 (+ 2320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.916946 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:04.917632 (+ 686us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:04.918564 (+ 932us) server_negotiation.cc:299] Negotiation successful
0808 15:01:04.918750 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1262,"thread_start_us":1402,"threads_started":1}
I20260808 15:01:04.919924 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:04.905725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47070 (local address 127.12.73.130:38273)
0808 15:01:04.906546 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:04.906559 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:04.908601 (+ 2042us) server_negotiation.cc:407] Connection header received
0808 15:01:04.908709 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:04.908716 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:04.908949 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:04.909130 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:04.909935 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.911448 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.914358 (+ 2910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:04.915739 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:04.915892 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:04.916149 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:04.917516 (+ 1367us) server_negotiation.cc:299] Negotiation successful
0808 15:01:04.917714 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":571,"threads_started":1}
I20260808 15:01:04.921087 9603 tablet_service.cc:1467] Processing CreateTablet for tablet 5905b1f43ede40a4a01a277db410e2ef (DEFAULT_TABLE table=test-table [id=04dc2182e6bb40f79df411e9f798141f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:04.922632 9603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5905b1f43ede40a4a01a277db410e2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:04.922447 10086 tablet_service.cc:1467] Processing CreateTablet for tablet 5905b1f43ede40a4a01a277db410e2ef (DEFAULT_TABLE table=test-table [id=04dc2182e6bb40f79df411e9f798141f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:04.923372 9840 tablet_service.cc:1467] Processing CreateTablet for tablet 5905b1f43ede40a4a01a277db410e2ef (DEFAULT_TABLE table=test-table [id=04dc2182e6bb40f79df411e9f798141f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:04.924039 10086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5905b1f43ede40a4a01a277db410e2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:04.924708 9840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5905b1f43ede40a4a01a277db410e2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:04.934017 10245 tablet_bootstrap.cc:492] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7: Bootstrap starting.
I20260808 15:01:04.938611 10245 tablet_bootstrap.cc:654] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:04.939183 10248 tablet_bootstrap.cc:492] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce: Bootstrap starting.
I20260808 15:01:04.940146 10245 log.cc:824] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:04.941744 10252 tablet_bootstrap.cc:492] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774: Bootstrap starting.
I20260808 15:01:04.943030 10248 tablet_bootstrap.cc:654] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:04.943414 10245 tablet_bootstrap.cc:492] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7: No bootstrap required, opened a new log
I20260808 15:01:04.943728 10245 ts_tablet_manager.cc:1397] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260808 15:01:04.945590 10248 log.cc:824] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:04.945772 10252 tablet_bootstrap.cc:654] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:04.946908 10252 log.cc:824] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:04.948858 10248 tablet_bootstrap.cc:492] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce: No bootstrap required, opened a new log
I20260808 15:01:04.949152 10248 ts_tablet_manager.cc:1397] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260808 15:01:04.950107 10252 tablet_bootstrap.cc:492] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774: No bootstrap required, opened a new log
I20260808 15:01:04.950392 10252 ts_tablet_manager.cc:1397] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260808 15:01:04.952373 10245 raft_consensus.cc:348] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0694d59eddf44e7bb5eefb3253f77cf7" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38821 } } peers { permanent_uuid: "42b289cc4597443684724bb64c66f774" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 38273 } } peers { permanent_uuid: "2845f479ad5547c19c63ca689b9f72ce" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43389 } }
I20260808 15:01:04.952767 10245 raft_consensus.cc:374] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:04.952900 10245 raft_consensus.cc:729] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0694d59eddf44e7bb5eefb3253f77cf7, State: Initialized, Role: FOLLOWER
I20260808 15:01:04.953558 10245 consensus_queue.cc:260] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0694d59eddf44e7bb5eefb3253f77cf7" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38821 } } peers { permanent_uuid: "42b289cc4597443684724bb64c66f774" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 38273 } } peers { permanent_uuid: "2845f479ad5547c19c63ca689b9f72ce" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43389 } }
I20260808 15:01:04.955456 10245 ts_tablet_manager.cc:1428] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260808 15:01:04.960520 10248 raft_consensus.cc:348] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0694d59eddf44e7bb5eefb3253f77cf7" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38821 } } peers { permanent_uuid: "42b289cc4597443684724bb64c66f774" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 38273 } } peers { permanent_uuid: "2845f479ad5547c19c63ca689b9f72ce" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43389 } }
I20260808 15:01:04.960980 10248 raft_consensus.cc:374] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:04.961084 10248 raft_consensus.cc:729] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2845f479ad5547c19c63ca689b9f72ce, State: Initialized, Role: FOLLOWER
I20260808 15:01:04.961743 10248 consensus_queue.cc:260] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0694d59eddf44e7bb5eefb3253f77cf7" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38821 } } peers { permanent_uuid: "42b289cc4597443684724bb64c66f774" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 38273 } } peers { permanent_uuid: "2845f479ad5547c19c63ca689b9f72ce" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43389 } }
I20260808 15:01:04.962531 10252 raft_consensus.cc:348] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0694d59eddf44e7bb5eefb3253f77cf7" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38821 } } peers { permanent_uuid: "42b289cc4597443684724bb64c66f774" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 38273 } } peers { permanent_uuid: "2845f479ad5547c19c63ca689b9f72ce" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43389 } }
I20260808 15:01:04.962818 10206 heartbeater.cc:503] Master 127.12.73.190:43513 was elected leader, sending a full tablet report...
I20260808 15:01:04.962966 10252 raft_consensus.cc:374] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:04.963085 10252 raft_consensus.cc:729] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b289cc4597443684724bb64c66f774, State: Initialized, Role: FOLLOWER
I20260808 15:01:04.963654 10248 ts_tablet_manager.cc:1428] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce: Time spent starting tablet: real 0.014s user 0.011s sys 0.002s
I20260808 15:01:04.963688 10252 consensus_queue.cc:260] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0694d59eddf44e7bb5eefb3253f77cf7" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38821 } } peers { permanent_uuid: "42b289cc4597443684724bb64c66f774" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 38273 } } peers { permanent_uuid: "2845f479ad5547c19c63ca689b9f72ce" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43389 } }
I20260808 15:01:04.964892 9962 heartbeater.cc:503] Master 127.12.73.190:43513 was elected leader, sending a full tablet report...
I20260808 15:01:04.965564 10252 ts_tablet_manager.cc:1428] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774: Time spent starting tablet: real 0.015s user 0.012s sys 0.003s
W20260808 15:01:05.092638 10212 tablet.cc:2369] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:01:05.103292 10264 raft_consensus.cc:482] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:01:05.103646 10264 raft_consensus.cc:504] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0694d59eddf44e7bb5eefb3253f77cf7" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38821 } } peers { permanent_uuid: "42b289cc4597443684724bb64c66f774" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 38273 } } peers { permanent_uuid: "2845f479ad5547c19c63ca689b9f72ce" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43389 } }
I20260808 15:01:05.105569 10264 leader_election.cc:288] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0694d59eddf44e7bb5eefb3253f77cf7 (127.12.73.129:38821), 2845f479ad5547c19c63ca689b9f72ce (127.12.73.131:43389)
W20260808 15:01:05.112388 9965 tablet.cc:2369] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:01:05.112704 10244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:05.106126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:39473 (local address 127.12.73.131:43389)
0808 15:01:05.106305 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:05.106309 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:05.107356 (+ 1047us) server_negotiation.cc:407] Connection header received
0808 15:01:05.107558 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:05.107563 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:05.107623 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:05.107731 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:05.108406 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.109099 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.110966 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.111750 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.111920 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:05.112003 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:05.112319 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 15:01:05.112444 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:01:05.112772 10240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:05.105922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:42951 (local address 127.12.73.129:38821)
0808 15:01:05.106136 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:05.106142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:05.107260 (+ 1118us) server_negotiation.cc:407] Connection header received
0808 15:01:05.107528 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:05.107532 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:05.107604 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:05.107705 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:05.108293 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.108991 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.110957 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.111720 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.111908 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:05.111983 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:05.112394 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 15:01:05.112536 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 15:01:05.112815 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:05.106112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:43389 (local address 127.12.73.130:39473)
0808 15:01:05.107235 (+ 1123us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:05.107255 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:05.107409 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:05.107746 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:05.107750 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:05.107772 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:05.108247 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:05.108256 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.109290 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.109295 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:05.110753 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:05.110765 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.111993 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.112001 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:05.112154 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:05.112178 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:01:05.112290 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 15:01:05.112424 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":998,"mutex_wait_us":25,"spinlock_wait_cycles":21888,"thread_start_us":648,"threads_started":1}
I20260808 15:01:05.113451 10267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:05.106068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:38821 (local address 127.12.73.130:42951)
0808 15:01:05.107137 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:05.107154 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:05.107351 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:05.107723 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:05.107727 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:05.107751 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:05.108146 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:05.108154 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.109124 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.109130 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:05.110748 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:05.110760 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.111939 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.111946 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:05.112185 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:05.112218 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 15:01:05.112980 (+ 762us) client_negotiation.cc:240] Negotiation successful
0808 15:01:05.113094 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":877,"mutex_wait_us":26,"thread_start_us":594,"threads_started":1}
I20260808 15:01:05.114319 10132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5905b1f43ede40a4a01a277db410e2ef" candidate_uuid: "42b289cc4597443684724bb64c66f774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2845f479ad5547c19c63ca689b9f72ce" is_pre_election: true
I20260808 15:01:05.114460 9637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5905b1f43ede40a4a01a277db410e2ef" candidate_uuid: "42b289cc4597443684724bb64c66f774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0694d59eddf44e7bb5eefb3253f77cf7" is_pre_election: true
I20260808 15:01:05.114943 10132 raft_consensus.cc:2454] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42b289cc4597443684724bb64c66f774 in term 0.
I20260808 15:01:05.115001 9637 raft_consensus.cc:2454] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42b289cc4597443684724bb64c66f774 in term 0.
I20260808 15:01:05.115741 9760 leader_election.cc:302] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0694d59eddf44e7bb5eefb3253f77cf7, 2845f479ad5547c19c63ca689b9f72ce, 42b289cc4597443684724bb64c66f774; no voters:
I20260808 15:01:05.116458 10264 raft_consensus.cc:2781] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:01:05.116606 10264 raft_consensus.cc:482] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:01:05.116742 10264 raft_consensus.cc:3037] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:05.119125 10264 raft_consensus.cc:504] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0694d59eddf44e7bb5eefb3253f77cf7" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38821 } } peers { permanent_uuid: "42b289cc4597443684724bb64c66f774" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 38273 } } peers { permanent_uuid: "2845f479ad5547c19c63ca689b9f72ce" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43389 } }
I20260808 15:01:05.119732 10264 leader_election.cc:288] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [CANDIDATE]: Term 1 election: Requested vote from peers 0694d59eddf44e7bb5eefb3253f77cf7 (127.12.73.129:38821), 2845f479ad5547c19c63ca689b9f72ce (127.12.73.131:43389)
I20260808 15:01:05.120280 10132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5905b1f43ede40a4a01a277db410e2ef" candidate_uuid: "42b289cc4597443684724bb64c66f774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2845f479ad5547c19c63ca689b9f72ce"
I20260808 15:01:05.120283 9637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5905b1f43ede40a4a01a277db410e2ef" candidate_uuid: "42b289cc4597443684724bb64c66f774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0694d59eddf44e7bb5eefb3253f77cf7"
I20260808 15:01:05.120501 9637 raft_consensus.cc:3037] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:05.120479 10132 raft_consensus.cc:3037] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:05.122789 10132 raft_consensus.cc:2454] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b289cc4597443684724bb64c66f774 in term 1.
I20260808 15:01:05.123077 9637 raft_consensus.cc:2454] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b289cc4597443684724bb64c66f774 in term 1.
I20260808 15:01:05.123243 9755 leader_election.cc:302] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2845f479ad5547c19c63ca689b9f72ce, 42b289cc4597443684724bb64c66f774; no voters:
I20260808 15:01:05.123566 10264 raft_consensus.cc:2781] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:05.124017 10264 raft_consensus.cc:686] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 1 LEADER]: Becoming Leader. State: Replica: 42b289cc4597443684724bb64c66f774, State: Running, Role: LEADER
I20260808 15:01:05.124519 10264 consensus_queue.cc:237] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0694d59eddf44e7bb5eefb3253f77cf7" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38821 } } peers { permanent_uuid: "42b289cc4597443684724bb64c66f774" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 38273 } } peers { permanent_uuid: "2845f479ad5547c19c63ca689b9f72ce" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43389 } }
I20260808 15:01:05.128978 9374 catalog_manager.cc:5495] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42b289cc4597443684724bb64c66f774 (127.12.73.130). New cstate: current_term: 1 leader_uuid: "42b289cc4597443684724bb64c66f774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0694d59eddf44e7bb5eefb3253f77cf7" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b289cc4597443684724bb64c66f774" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 38273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2845f479ad5547c19c63ca689b9f72ce" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
W20260808 15:01:05.143668 9717 tablet.cc:2369] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:01:05.153898 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:05.148916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47078 (local address 127.12.73.130:38273)
0808 15:01:05.149091 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:05.149095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:05.149111 (+ 16us) server_negotiation.cc:407] Connection header received
0808 15:01:05.149239 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:05.149244 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:05.149341 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:05.149463 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:01:05.149794 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.150488 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.151823 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.152232 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.152322 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:05.152735 (+ 413us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:01:05.153312 (+ 577us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:01:05.153418 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:05.153518 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 15:01:05.153579 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:01:05.162104 9637 raft_consensus.cc:1261] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7 [term 1 FOLLOWER]: Refusing update from remote peer 42b289cc4597443684724bb64c66f774: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:01:05.162104 10132 raft_consensus.cc:1261] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce [term 1 FOLLOWER]: Refusing update from remote peer 42b289cc4597443684724bb64c66f774: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:01:05.163170 10271 consensus_queue.cc:1035] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0694d59eddf44e7bb5eefb3253f77cf7" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 38821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:01:05.163550 10264 consensus_queue.cc:1035] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2845f479ad5547c19c63ca689b9f72ce" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:01:05.173952 10278 mvcc.cc:205] Tried to move back new op lower bound from 7316280382093406208 to 7316280381954002944. Current Snapshot: MvccSnapshot[applied={T|T < 7316280382093406208}]
I20260808 15:01:05.174607 10276 mvcc.cc:205] Tried to move back new op lower bound from 7316280382093406208 to 7316280381954002944. Current Snapshot: MvccSnapshot[applied={T|T < 7316280382093406208}]
I20260808 15:01:05.179008 10277 mvcc.cc:205] Tried to move back new op lower bound from 7316280382093406208 to 7316280381954002944. Current Snapshot: MvccSnapshot[applied={T|T < 7316280382093406208}]
I20260808 15:01:05.188968 9372 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:01:05.189325 9372 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:01:05.193358 9372 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6e58013bda9c484c8412ea8fcec100dd: Sending DeleteTablet for 3 replicas of tablet 5905b1f43ede40a4a01a277db410e2ef
I20260808 15:01:05.194695 9603 tablet_service.cc:1514] Processing DeleteTablet for tablet 5905b1f43ede40a4a01a277db410e2ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:05 UTC) from {username='slave'} at 127.0.0.1:42528
I20260808 15:01:05.194739 9840 tablet_service.cc:1514] Processing DeleteTablet for tablet 5905b1f43ede40a4a01a277db410e2ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:05 UTC) from {username='slave'} at 127.0.0.1:47070
I20260808 15:01:05.195756 10086 tablet_service.cc:1514] Processing DeleteTablet for tablet 5905b1f43ede40a4a01a277db410e2ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:05 UTC) from {username='slave'} at 127.0.0.1:37422
I20260808 15:01:05.196012 10288 tablet_replica.cc:330] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7: stopping tablet replica
I20260808 15:01:05.196471 10288 raft_consensus.cc:2229] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:01:05.196750 10291 tablet_replica.cc:330] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce: stopping tablet replica
I20260808 15:01:05.197036 10288 raft_consensus.cc:2258] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:05.197325 10291 raft_consensus.cc:2229] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:01:05.197849 10291 raft_consensus.cc:2258] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:05.198009 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 9483
I20260808 15:01:05.198016 10289 tablet_replica.cc:330] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774: stopping tablet replica
I20260808 15:01:05.198457 10289 raft_consensus.cc:2229] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:01:05.199251 10289 raft_consensus.cc:2258] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:05.200760 10291 ts_tablet_manager.cc:1905] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:05.201992 10289 ts_tablet_manager.cc:1905] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:05.205212 10288 ts_tablet_manager.cc:1905] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:05.211202 10289 ts_tablet_manager.cc:1918] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:05.211395 10289 log.cc:1196] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/5905b1f43ede40a4a01a277db410e2ef
I20260808 15:01:05.212049 10289 ts_tablet_manager.cc:1939] T 5905b1f43ede40a4a01a277db410e2ef P 42b289cc4597443684724bb64c66f774: Deleting consensus metadata
I20260808 15:01:05.213281 10288 ts_tablet_manager.cc:1918] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:05.213465 10288 log.cc:1196] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/5905b1f43ede40a4a01a277db410e2ef
I20260808 15:01:05.214141 10288 ts_tablet_manager.cc:1939] T 5905b1f43ede40a4a01a277db410e2ef P 0694d59eddf44e7bb5eefb3253f77cf7: Deleting consensus metadata
I20260808 15:01:05.214140 9345 catalog_manager.cc:4841] TS 42b289cc4597443684724bb64c66f774 (127.12.73.130:38273): tablet 5905b1f43ede40a4a01a277db410e2ef (table test-table [id=04dc2182e6bb40f79df411e9f798141f]) successfully deleted
I20260808 15:01:05.215818 10240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:05.200007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42532 (local address 127.12.73.129:38821)
0808 15:01:05.200187 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:05.200193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:05.203887 (+ 3694us) server_negotiation.cc:407] Connection header received
0808 15:01:05.204173 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:05.204179 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:05.204278 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:05.204358 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:05.205445 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.206655 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.211455 (+ 4800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.212172 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.212280 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:05.214045 (+ 1765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:05.214057 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:05.214073 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:05.214854 (+ 781us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:05.214919 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:05.214944 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:05.215054 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:05.215294 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 15:01:05.215407 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":58}
I20260808 15:01:05.216097 9349 catalog_manager.cc:4841] TS 0694d59eddf44e7bb5eefb3253f77cf7 (127.12.73.129:38821): tablet 5905b1f43ede40a4a01a277db410e2ef (table test-table [id=04dc2182e6bb40f79df411e9f798141f]) successfully deleted
I20260808 15:01:05.216662 10291 ts_tablet_manager.cc:1918] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:05.216862 10291 log.cc:1196] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/5905b1f43ede40a4a01a277db410e2ef
I20260808 15:01:05.216967 9706 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:05.217499 10291 ts_tablet_manager.cc:1939] T 5905b1f43ede40a4a01a277db410e2ef P 2845f479ad5547c19c63ca689b9f72ce: Deleting consensus metadata
I20260808 15:01:05.218967 9347 catalog_manager.cc:4841] TS 2845f479ad5547c19c63ca689b9f72ce (127.12.73.131:43389): tablet 5905b1f43ede40a4a01a277db410e2ef (table test-table [id=04dc2182e6bb40f79df411e9f798141f]) successfully deleted
I20260808 15:01:05.311796 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 9483
I20260808 15:01:05.348152 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 9722
I20260808 15:01:05.357470 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:05.348971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47090 (local address 127.12.73.130:38273)
0808 15:01:05.349267 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:05.349273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:05.349338 (+ 65us) server_negotiation.cc:407] Connection header received
0808 15:01:05.349547 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:05.349554 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:05.349659 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:05.349766 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:05.350191 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.351342 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.353310 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.354012 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.354138 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:05.355712 (+ 1574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:05.355728 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:05.355747 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:05.356550 (+ 803us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:05.356611 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:05.356637 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:05.356753 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:05.356915 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 15:01:05.357023 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260808 15:01:05.358301 9955 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:05.473445 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 9722
I20260808 15:01:05.500916 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 9968
I20260808 15:01:05.508167 10244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:05.501794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37436 (local address 127.12.73.131:43389)
0808 15:01:05.501990 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:05.501996 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:05.502016 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:01:05.502251 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:05.502256 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:05.502352 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:05.502466 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:05.502905 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.503613 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.504924 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:05.505546 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:05.505684 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:05.506778 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:05.506788 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:05.506802 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:05.507353 (+ 551us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:05.507428 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:05.507462 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:05.507596 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:05.507733 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 15:01:05.507844 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:01:05.508821 10198 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:05.597700 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 9968
I20260808 15:01:05.623870 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 9321
I20260808 15:01:05.624929 9429 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:05.733897 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 9321
2026-08-08T15:01:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2923 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:05 dist-test-slave-z8x9 krb5kdc[10311](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:05 dist-test-slave-z8x9 krb5kdc[10311](info): set up 2 sockets
Aug 08 15:01:05 dist-test-slave-z8x9 krb5kdc[10311](info): commencing operation
krb5kdc: starting...
W20260808 15:01:07.094952 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.007s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:07 dist-test-slave-z8x9 krb5kdc[10311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 15:01:07.408309 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:43587
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:43587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:07.746161 10339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:07.746475 10339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:07.746659 10339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:07.754082 10339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:07.754262 10339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:07.754395 10339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:07.754504 10339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:07.754587 10339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:07.764763 10339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:43587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:43587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:07.766109 10339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:07.767566 10339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:07.779402 10346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:07.779425 10348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:07.779492 10352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:07.780311 10339 server_base.cc:1034] running on GCE node
I20260808 15:01:07.781086 10339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:07.782527 10339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:07.783735 10339 hybrid_clock.cc:648] HybridClock initialized: now 1786201267783689 us; error 30 us; skew 500 ppm
I20260808 15:01:07.784042 10339 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:07 dist-test-slave-z8x9 krb5kdc[10311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201267, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:07.787142 10339 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:01:07.788587 10339 webserver.cc:460] Webserver started at http://127.12.73.190:33387/ using document root <none> and password file <none>
I20260808 15:01:07.789289 10339 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:07.789402 10339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:07.789659 10339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:07.792573 10339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "4c6d7da7589f47a3a5ead42c8d92f459"
format_stamp: "Formatted at 2026-08-08 15:01:07 on dist-test-slave-z8x9"
server_key: "69fd84ea8febbf5b480c48920cb2b2f9"
server_key_iv: "5590dc7f690ea2c0d9c34c5250389614"
server_key_version: "encryptionkey@0"
I20260808 15:01:07.793365 10339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "4c6d7da7589f47a3a5ead42c8d92f459"
format_stamp: "Formatted at 2026-08-08 15:01:07 on dist-test-slave-z8x9"
server_key: "69fd84ea8febbf5b480c48920cb2b2f9"
server_key_iv: "5590dc7f690ea2c0d9c34c5250389614"
server_key_version: "encryptionkey@0"
I20260808 15:01:07.798555 10339 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 15:01:07.801930 10362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:07.803258 10339 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:01:07.803431 10339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "4c6d7da7589f47a3a5ead42c8d92f459"
format_stamp: "Formatted at 2026-08-08 15:01:07 on dist-test-slave-z8x9"
server_key: "69fd84ea8febbf5b480c48920cb2b2f9"
server_key_iv: "5590dc7f690ea2c0d9c34c5250389614"
server_key_version: "encryptionkey@0"
I20260808 15:01:07.803635 10339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:07.823455 10339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:07.827409 10339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:07.827713 10339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:07.846690 10339 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:43587
I20260808 15:01:07.846724 10460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:43587 every 8 connection(s)
I20260808 15:01:07.848084 10339 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:07.849604 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 10339
I20260808 15:01:07.849798 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:07.850384 12582 external_mini_cluster.cc:1428] Setting key 43d7aec0a5c19571622662b8269898d3
I20260808 15:01:07.852803 10465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 15:01:07 dist-test-slave-z8x9 krb5kdc[10311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:07.866426 10465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459: Bootstrap starting.
I20260808 15:01:07.869879 10465 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:07.870920 10465 log.cc:824] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:07.874202 10465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459: No bootstrap required, opened a new log
I20260808 15:01:07.874608 10471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:07.852282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37712 (local address 127.12.73.190:43587)
0808 15:01:07.853089 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:07.853101 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:07.853141 (+ 40us) server_negotiation.cc:407] Connection header received
0808 15:01:07.854845 (+ 1704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:07.854867 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:07.855241 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:07.855577 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:07.857668 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:07.858993 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:07.860867 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:07.861596 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:07.861718 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:07.866742 (+ 5024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:07.866754 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:07.866769 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:07.866805 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:07.870172 (+ 3367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:07.870889 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:07.870905 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:07.870911 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:07.871110 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:07.871603 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:07.871608 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:07.871611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:07.872168 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:07.872464 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:07.872860 (+ 396us) server_negotiation.cc:299] Negotiation successful
0808 15:01:07.873331 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":357,"threads_started":1}
I20260808 15:01:07.882221 10465 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6d7da7589f47a3a5ead42c8d92f459" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43587 } }
I20260808 15:01:07.882579 10465 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:07.882660 10465 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c6d7da7589f47a3a5ead42c8d92f459, State: Initialized, Role: FOLLOWER
I20260808 15:01:07.883148 10465 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6d7da7589f47a3a5ead42c8d92f459" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43587 } }
I20260808 15:01:07.883347 10465 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:07.883445 10465 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:07.883569 10465 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:07.885895 10465 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6d7da7589f47a3a5ead42c8d92f459" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43587 } }
I20260808 15:01:07.886417 10465 leader_election.cc:302] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c6d7da7589f47a3a5ead42c8d92f459; no voters:
I20260808 15:01:07.887027 10465 leader_election.cc:288] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:07.887177 10476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:07.887867 10476 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [term 1 LEADER]: Becoming Leader. State: Replica: 4c6d7da7589f47a3a5ead42c8d92f459, State: Running, Role: LEADER
I20260808 15:01:07.888375 10476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6d7da7589f47a3a5ead42c8d92f459" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43587 } }
I20260808 15:01:07.889078 10465 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:07.890997 10478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c6d7da7589f47a3a5ead42c8d92f459" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6d7da7589f47a3a5ead42c8d92f459" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43587 } } }
I20260808 15:01:07.891335 10478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:07.893342 10479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c6d7da7589f47a3a5ead42c8d92f459. Latest consensus state: current_term: 1 leader_uuid: "4c6d7da7589f47a3a5ead42c8d92f459" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6d7da7589f47a3a5ead42c8d92f459" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 43587 } } }
I20260808 15:01:07.893635 10479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:07.898496 10484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:07.903914 10484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:07.912948 10484 catalog_manager.cc:1347] Generated new cluster ID: fa4258ff2ccf4bfe8af578ea95a045b9
I20260808 15:01:07.913074 10484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:07.938899 10484 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:07.940560 10484 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:07.948665 10484 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459: Generated new TSK 0
I20260808 15:01:07.949507 10484 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 15:01:08.036645 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43587
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:08.383299 10517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:08.383587 10517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:08.383683 10517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:08.391147 10517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:08.391258 10517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:08.391366 10517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 15:01:08.401630 10517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:08.402817 10517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:08.404048 10517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:08.417032 10537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:08.417145 10532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:08.417145 10533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:08.418129 10517 server_base.cc:1034] running on GCE node
I20260808 15:01:08.418748 10517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:08.419615 10517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:08.420814 10517 hybrid_clock.cc:648] HybridClock initialized: now 1786201268420779 us; error 27 us; skew 500 ppm
I20260808 15:01:08.421072 10517 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:08 dist-test-slave-z8x9 krb5kdc[10311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201268, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:08.428193 10517 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 15:01:08.429595 10517 webserver.cc:460] Webserver started at http://127.12.73.129:44021/ using document root <none> and password file <none>
I20260808 15:01:08.430197 10517 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:08.430302 10517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:08.430569 10517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:08.433413 10517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "9286e0d9badb45b2a4707e6abc774811"
format_stamp: "Formatted at 2026-08-08 15:01:08 on dist-test-slave-z8x9"
server_key: "b74b92f7f9645779c22e60daaae24fcc"
server_key_iv: "732e62f6cc6fa4f43448b669817558a1"
server_key_version: "encryptionkey@0"
I20260808 15:01:08.434111 10517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "9286e0d9badb45b2a4707e6abc774811"
format_stamp: "Formatted at 2026-08-08 15:01:08 on dist-test-slave-z8x9"
server_key: "b74b92f7f9645779c22e60daaae24fcc"
server_key_iv: "732e62f6cc6fa4f43448b669817558a1"
server_key_version: "encryptionkey@0"
I20260808 15:01:08.439093 10517 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 15:01:08.442373 10551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:08.443621 10517 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 15:01:08.443797 10517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "9286e0d9badb45b2a4707e6abc774811"
format_stamp: "Formatted at 2026-08-08 15:01:08 on dist-test-slave-z8x9"
server_key: "b74b92f7f9645779c22e60daaae24fcc"
server_key_iv: "732e62f6cc6fa4f43448b669817558a1"
server_key_version: "encryptionkey@0"
I20260808 15:01:08.443987 10517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:08.467252 10517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:08.471468 10517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:08.471765 10517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:08.472744 10517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:08.474102 10517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:08.474179 10517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:08.474323 10517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:08.474390 10517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:08.508018 10517 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:42259
I20260808 15:01:08.508038 10742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:42259 every 8 connection(s)
I20260808 15:01:08.509435 10517 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 15:01:08.518456 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 10517
I20260808 15:01:08.518663 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 15:01:08.519105 12582 external_mini_cluster.cc:1428] Setting key 9d61b8ddd34e7d53e8044af080c865e6
Aug 08 15:01:08 dist-test-slave-z8x9 krb5kdc[10311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201268, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:08.529093 10750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:08.511947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:42619 (local address 127.12.73.190:43587)
0808 15:01:08.512354 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:08.512359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:08.513415 (+ 1056us) server_negotiation.cc:407] Connection header received
0808 15:01:08.515235 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:08.515241 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:08.515340 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:08.515462 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:08.516887 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:08.517720 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:08.519423 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:08.519814 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:08.519974 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:08.523447 (+ 3473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:08.523452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:08.523455 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:08.523485 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:08.526111 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:08.526819 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:08.526826 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:08.526829 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:08.526957 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:08.527394 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:08.527401 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:08.527404 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:08.527663 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:08.527822 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:08.528495 (+ 673us) server_negotiation.cc:299] Negotiation successful
0808 15:01:08.528710 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":207,"threads_started":1}
I20260808 15:01:08.529996 10751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:08.512509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:43587 (local address 127.12.73.129:42619)
0808 15:01:08.513270 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:08.513309 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:08.514975 (+ 1666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:08.515693 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:08.515700 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:08.516203 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:08.516717 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:08.516738 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:08.517891 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:08.517898 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:08.519267 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:08.519280 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:08.520080 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:08.520089 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:08.520338 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:08.521016 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:01:08.521038 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:08.523220 (+ 2182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:08.526258 (+ 3038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:08.526266 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:08.526280 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:08.526697 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:08.527073 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:08.527078 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:08.527082 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:08.527276 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:08.527795 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:08.527802 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:08.528114 (+ 312us) client_negotiation.cc:769] Sending connection context
0808 15:01:08.528379 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 15:01:08.528864 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":288,"threads_started":1}
I20260808 15:01:08.531613 10744 heartbeater.cc:347] Connected to a master server at 127.12.73.190:43587
I20260808 15:01:08.531909 10744 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:08.532586 10744 heartbeater.cc:511] Master 127.12.73.190:43587 requested a full tablet report, sending...
I20260808 15:01:08.534788 10400 ts_manager.cc:194] Registered new tserver with Master: 9286e0d9badb45b2a4707e6abc774811 (127.12.73.129:42259)
I20260808 15:01:08.536222 10400 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:42619
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 15:01:08.592058 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43587
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:08.938207 10760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:08.938548 10760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:08.938745 10760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:08.945960 10760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:08.946130 10760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:08.946310 10760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 15:01:08.956022 10760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:08.957417 10760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:08.958742 10760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:08.971920 10769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:08.971889 10772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:08.972159 10770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:08.973450 10760 server_base.cc:1034] running on GCE node
I20260808 15:01:08.974066 10760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:08.975009 10760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:08.976281 10760 hybrid_clock.cc:648] HybridClock initialized: now 1786201268976234 us; error 45 us; skew 500 ppm
I20260808 15:01:08.976642 10760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:08 dist-test-slave-z8x9 krb5kdc[10311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201268, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:08.980034 10760 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 15:01:08.981848 10760 webserver.cc:460] Webserver started at http://127.12.73.130:41699/ using document root <none> and password file <none>
I20260808 15:01:08.982583 10760 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:08.982739 10760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:08.983083 10760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:08.986110 10760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "1634cdd56e704dadaff67dcb177df17f"
format_stamp: "Formatted at 2026-08-08 15:01:08 on dist-test-slave-z8x9"
server_key: "84dd7e559850893a0b70ea0c9321e320"
server_key_iv: "9858c40ab77cbe12b188e00f8bb24ca4"
server_key_version: "encryptionkey@0"
I20260808 15:01:08.986903 10760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "1634cdd56e704dadaff67dcb177df17f"
format_stamp: "Formatted at 2026-08-08 15:01:08 on dist-test-slave-z8x9"
server_key: "84dd7e559850893a0b70ea0c9321e320"
server_key_iv: "9858c40ab77cbe12b188e00f8bb24ca4"
server_key_version: "encryptionkey@0"
I20260808 15:01:08.992297 10760 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 15:01:08.995877 10787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:08.997107 10760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:01:08.997400 10760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "1634cdd56e704dadaff67dcb177df17f"
format_stamp: "Formatted at 2026-08-08 15:01:08 on dist-test-slave-z8x9"
server_key: "84dd7e559850893a0b70ea0c9321e320"
server_key_iv: "9858c40ab77cbe12b188e00f8bb24ca4"
server_key_version: "encryptionkey@0"
I20260808 15:01:08.997611 10760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:09.037705 10760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:09.042322 10760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:09.042689 10760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:09.043705 10760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:09.045047 10760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:09.045162 10760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:09.045354 10760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:09.045439 10760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:09.079252 10760 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:34295
I20260808 15:01:09.079303 10969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:34295 every 8 connection(s)
I20260808 15:01:09.080590 10760 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 15:01:09.083820 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 10760
I20260808 15:01:09.084026 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 15:01:09.084635 12582 external_mini_cluster.cc:1428] Setting key aef7547fb27aa310215ac026b90bc90a
Aug 08 15:01:09 dist-test-slave-z8x9 krb5kdc[10311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201268, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:09.104818 10977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.083741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:33517 (local address 127.12.73.190:43587)
0808 15:01:09.084388 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:09.084396 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:09.086374 (+ 1978us) server_negotiation.cc:407] Connection header received
0808 15:01:09.087272 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:09.087278 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:09.087366 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:09.087501 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:09.089054 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.089886 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.092446 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.092913 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.093352 (+ 439us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.097755 (+ 4403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:09.097764 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:09.097771 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:09.097817 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:09.101380 (+ 3563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:09.102445 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:09.102449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:09.102451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:09.102610 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:09.103125 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:09.103128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:09.103130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:09.103388 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:09.103502 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:09.104395 (+ 893us) server_negotiation.cc:299] Negotiation successful
0808 15:01:09.104560 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":381,"threads_started":1}
I20260808 15:01:09.106504 10979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.084354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:43587 (local address 127.12.73.130:33517)
0808 15:01:09.085235 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:09.085288 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:09.086999 (+ 1711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:09.087748 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:09.087756 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:09.088297 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:09.088883 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.088912 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.090134 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.090143 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.092281 (+ 2138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.092300 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.093449 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.093459 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.093827 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.094615 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:01:09.094650 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:09.097514 (+ 2864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:09.101534 (+ 4020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:09.101544 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:09.101562 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:09.102330 (+ 768us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:09.102739 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:09.102747 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:09.102753 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:09.103010 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:09.103532 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:09.103543 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:09.103990 (+ 447us) client_negotiation.cc:769] Sending connection context
0808 15:01:09.104322 (+ 332us) client_negotiation.cc:240] Negotiation successful
0808 15:01:09.104930 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":350,"threads_started":1}
I20260808 15:01:09.108137 10971 heartbeater.cc:347] Connected to a master server at 127.12.73.190:43587
I20260808 15:01:09.108481 10971 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:09.109433 10971 heartbeater.cc:511] Master 127.12.73.190:43587 requested a full tablet report, sending...
I20260808 15:01:09.111043 10400 ts_manager.cc:194] Registered new tserver with Master: 1634cdd56e704dadaff67dcb177df17f (127.12.73.130:34295)
I20260808 15:01:09.111900 10400 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:33517
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 15:01:09.160034 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43587
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:39609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:09.495676 10985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:09.495927 10985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:09.496083 10985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:09.503451 10985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:09.503571 10985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:09.503774 10985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 15:01:09.515699 10985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:39609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:43587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:09.516837 10985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:09.518170 10985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:09.531060 10995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:09.531002 10996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:09.530970 10998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:09.532269 10985 server_base.cc:1034] running on GCE node
I20260808 15:01:09.532814 10985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:09.533739 10985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:09.534934 10985 hybrid_clock.cc:648] HybridClock initialized: now 1786201269534881 us; error 52 us; skew 500 ppm
I20260808 15:01:09.535246 10985 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:09 dist-test-slave-z8x9 krb5kdc[10311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201269, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:09.538586 10985 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 15:01:09.539244 10744 heartbeater.cc:503] Master 127.12.73.190:43587 was elected leader, sending a full tablet report...
I20260808 15:01:09.540475 10985 webserver.cc:460] Webserver started at http://127.12.73.131:41275/ using document root <none> and password file <none>
I20260808 15:01:09.541412 10985 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:09.541568 10985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:09.541860 10985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:09.544737 10985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "a70cb000f48c4212b9d2d8ffd35f7abf"
format_stamp: "Formatted at 2026-08-08 15:01:09 on dist-test-slave-z8x9"
server_key: "abda8f217d6c15f775a28470b4525be9"
server_key_iv: "5ac05db8a8161c510c9197a1bcee2d8e"
server_key_version: "encryptionkey@0"
I20260808 15:01:09.545557 10985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "a70cb000f48c4212b9d2d8ffd35f7abf"
format_stamp: "Formatted at 2026-08-08 15:01:09 on dist-test-slave-z8x9"
server_key: "abda8f217d6c15f775a28470b4525be9"
server_key_iv: "5ac05db8a8161c510c9197a1bcee2d8e"
server_key_version: "encryptionkey@0"
I20260808 15:01:09.550899 10985 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 15:01:09.554275 11010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:09.555563 10985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:01:09.555739 10985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "a70cb000f48c4212b9d2d8ffd35f7abf"
format_stamp: "Formatted at 2026-08-08 15:01:09 on dist-test-slave-z8x9"
server_key: "abda8f217d6c15f775a28470b4525be9"
server_key_iv: "5ac05db8a8161c510c9197a1bcee2d8e"
server_key_version: "encryptionkey@0"
I20260808 15:01:09.555945 10985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:09.574132 10985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:09.578109 10985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:09.578400 10985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:09.579351 10985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:09.580735 10985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:09.580845 10985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:09.581017 10985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:09.581110 10985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:09.615453 10985 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:35529
I20260808 15:01:09.615509 11209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:35529 every 8 connection(s)
I20260808 15:01:09.616735 10985 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 15:01:09.621454 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 10985
I20260808 15:01:09.621660 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 15:01:09.622211 12582 external_mini_cluster.cc:1428] Setting key 81f0a50b57463fdd5f88ae5a9e7871c3
Aug 08 15:01:09 dist-test-slave-z8x9 krb5kdc[10311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201269, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:09.636963 11213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.619322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:42385 (local address 127.12.73.190:43587)
0808 15:01:09.619906 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:09.619911 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:09.620845 (+ 934us) server_negotiation.cc:407] Connection header received
0808 15:01:09.623380 (+ 2535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:09.623387 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:09.623470 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:09.623606 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:09.625510 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.626306 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.627744 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.628113 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.628204 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.631562 (+ 3358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:09.631566 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:09.631569 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:09.631598 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:09.634061 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:09.634704 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:09.634708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:09.634710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:09.634826 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:09.635192 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:09.635195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:09.635197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:09.635437 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:09.635552 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:09.636388 (+ 836us) server_negotiation.cc:299] Negotiation successful
0808 15:01:09.636546 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":320,"threads_started":1}
I20260808 15:01:09.638027 11214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.619928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:43587 (local address 127.12.73.131:42385)
0808 15:01:09.620668 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:09.620713 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:09.623085 (+ 2372us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:09.623902 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:09.623913 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:09.624594 (+ 681us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:09.625357 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.625379 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.626445 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.626449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.627625 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.627637 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.628332 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.628338 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.628525 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.629250 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:01:09.629280 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:09.631365 (+ 2085us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:09.634181 (+ 2816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:09.634187 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:09.634200 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:09.634597 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:09.634924 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:09.634927 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:09.634929 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:09.635094 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:09.635562 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:09.635570 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:09.635965 (+ 395us) client_negotiation.cc:769] Sending connection context
0808 15:01:09.636263 (+ 298us) client_negotiation.cc:240] Negotiation successful
0808 15:01:09.636780 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":317,"threads_started":1}
I20260808 15:01:09.639358 11210 heartbeater.cc:347] Connected to a master server at 127.12.73.190:43587
I20260808 15:01:09.639652 11210 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:09.640357 11210 heartbeater.cc:511] Master 127.12.73.190:43587 requested a full tablet report, sending...
I20260808 15:01:09.641814 10400 ts_manager.cc:194] Registered new tserver with Master: a70cb000f48c4212b9d2d8ffd35f7abf (127.12.73.131:35529)
I20260808 15:01:09.642609 10400 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:42385
I20260808 15:01:09.649770 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:01:09.666540 11213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.653927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37720 (local address 127.12.73.190:43587)
0808 15:01:09.654080 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:09.654085 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:09.654722 (+ 637us) server_negotiation.cc:407] Connection header received
0808 15:01:09.654835 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:09.654838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:09.654898 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:09.654979 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:09.656365 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.657213 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.658403 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.658794 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.658936 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.661681 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:09.661685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:09.661688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:09.661724 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:09.664111 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:09.664774 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:09.664778 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:09.664780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:09.664885 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:09.665362 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:09.665365 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:09.665367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:09.665658 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:09.665860 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:09.666189 (+ 329us) server_negotiation.cc:299] Negotiation successful
0808 15:01:09.666321 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 15:01:09.670504 10400 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37720:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:01:09.677448 10400 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:01:09.714371 11241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.690535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59822 (local address 127.12.73.129:42259)
0808 15:01:09.703393 (+ 12858us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:09.703407 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:09.704301 (+ 894us) server_negotiation.cc:407] Connection header received
0808 15:01:09.704459 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:09.704471 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:09.704779 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:09.705039 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:09.706740 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.708446 (+ 1706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.711220 (+ 2774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.712785 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.712935 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.713213 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:09.713847 (+ 634us) server_negotiation.cc:299] Negotiation successful
0808 15:01:09.714012 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12613,"thread_start_us":12403,"threads_started":1}
I20260808 15:01:09.714388 11240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.689537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:42259 (local address 127.0.0.1:59822)
0808 15:01:09.703957 (+ 14420us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:09.703981 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:09.704135 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:09.705936 (+ 1801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:09.705948 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:09.706004 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:09.706570 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.706581 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.708638 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.708643 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.711050 (+ 2407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.711065 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.713345 (+ 2280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.713352 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.713543 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.713595 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 15:01:09.713714 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 15:01:09.713915 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14244,"mutex_wait_us":1,"thread_start_us":16690,"threads_started":1}
I20260808 15:01:09.715204 11236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.689886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:35529 (local address 127.0.0.1:45980)
0808 15:01:09.707066 (+ 17180us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:09.707084 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:09.707328 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:09.708231 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:09.708235 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:09.708257 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:09.708651 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.708665 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.710203 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.710208 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.712018 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.712035 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.714265 (+ 2230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.714272 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.714465 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.714502 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 15:01:09.714603 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 15:01:09.714748 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17044,"mutex_wait_us":1,"spinlock_wait_cycles":3456,"thread_start_us":13712,"threads_started":1}
I20260808 15:01:09.715835 11234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.688993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:34295 (local address 127.0.0.1:34802)
0808 15:01:09.701503 (+ 12510us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:09.701557 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:09.701730 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:09.707279 (+ 5549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:09.707285 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:09.707333 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:09.707739 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.707750 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.709828 (+ 2078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.709841 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.711814 (+ 1973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.711829 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.714984 (+ 3155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.714990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.715214 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.715236 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 15:01:09.715373 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 15:01:09.715493 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12233,"mutex_wait_us":83,"spinlock_wait_cycles":1280,"thread_start_us":12979,"threads_started":1}
I20260808 15:01:09.716113 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.689565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45980 (local address 127.12.73.131:35529)
0808 15:01:09.705939 (+ 16374us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:09.705952 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:09.707176 (+ 1224us) server_negotiation.cc:407] Connection header received
0808 15:01:09.707542 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:09.707549 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:09.707745 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:09.707948 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:09.708823 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.710049 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.712254 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.713774 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.713910 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.714111 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:09.715450 (+ 1339us) server_negotiation.cc:299] Negotiation successful
0808 15:01:09.715616 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16132,"thread_start_us":15944,"threads_started":1}
I20260808 15:01:09.716594 11235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.689229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34802 (local address 127.12.73.130:34295)
0808 15:01:09.706639 (+ 17410us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:09.706648 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:09.706675 (+ 27us) server_negotiation.cc:407] Connection header received
0808 15:01:09.706810 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:09.706817 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:09.707054 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:09.707950 (+ 896us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:09.708130 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.709670 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.713037 (+ 3367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.714766 (+ 1729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.714926 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.715144 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:09.716076 (+ 932us) server_negotiation.cc:299] Negotiation successful
0808 15:01:09.716258 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17242,"thread_start_us":18131,"threads_started":1}
I20260808 15:01:09.718767 10628 tablet_service.cc:1467] Processing CreateTablet for tablet 9232cbc7f1f54750a5c8f6b7724cba8c (DEFAULT_TABLE table=test-table [id=45e19b440ef44e969ee953040dac014b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:09.719350 10865 tablet_service.cc:1467] Processing CreateTablet for tablet 9232cbc7f1f54750a5c8f6b7724cba8c (DEFAULT_TABLE table=test-table [id=45e19b440ef44e969ee953040dac014b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:09.719739 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 9232cbc7f1f54750a5c8f6b7724cba8c (DEFAULT_TABLE table=test-table [id=45e19b440ef44e969ee953040dac014b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:09.720809 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9232cbc7f1f54750a5c8f6b7724cba8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:09.721035 10628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9232cbc7f1f54750a5c8f6b7724cba8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:09.721095 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9232cbc7f1f54750a5c8f6b7724cba8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:09.732117 11242 tablet_bootstrap.cc:492] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f: Bootstrap starting.
I20260808 15:01:09.735324 11242 tablet_bootstrap.cc:654] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:09.735958 11243 tablet_bootstrap.cc:492] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf: Bootstrap starting.
I20260808 15:01:09.736722 11242 log.cc:824] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:09.738219 11244 tablet_bootstrap.cc:492] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811: Bootstrap starting.
I20260808 15:01:09.739884 11243 tablet_bootstrap.cc:654] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:09.740080 11242 tablet_bootstrap.cc:492] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f: No bootstrap required, opened a new log
I20260808 15:01:09.740450 11242 ts_tablet_manager.cc:1397] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260808 15:01:09.741253 11243 log.cc:824] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:09.742167 11244 tablet_bootstrap.cc:654] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:09.743352 11244 log.cc:824] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:09.744315 11243 tablet_bootstrap.cc:492] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf: No bootstrap required, opened a new log
I20260808 15:01:09.744572 11243 ts_tablet_manager.cc:1397] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260808 15:01:09.746376 11244 tablet_bootstrap.cc:492] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811: No bootstrap required, opened a new log
I20260808 15:01:09.746615 11244 ts_tablet_manager.cc:1397] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260808 15:01:09.748579 11242 raft_consensus.cc:348] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1634cdd56e704dadaff67dcb177df17f" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 34295 } } peers { permanent_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 35529 } } peers { permanent_uuid: "9286e0d9badb45b2a4707e6abc774811" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42259 } }
I20260808 15:01:09.748934 11242 raft_consensus.cc:374] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:09.749039 11242 raft_consensus.cc:729] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1634cdd56e704dadaff67dcb177df17f, State: Initialized, Role: FOLLOWER
I20260808 15:01:09.749672 11242 consensus_queue.cc:260] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1634cdd56e704dadaff67dcb177df17f" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 34295 } } peers { permanent_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 35529 } } peers { permanent_uuid: "9286e0d9badb45b2a4707e6abc774811" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42259 } }
I20260808 15:01:09.750743 10971 heartbeater.cc:503] Master 127.12.73.190:43587 was elected leader, sending a full tablet report...
I20260808 15:01:09.751358 11242 ts_tablet_manager.cc:1428] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f: Time spent starting tablet: real 0.011s user 0.009s sys 0.001s
I20260808 15:01:09.755502 11243 raft_consensus.cc:348] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1634cdd56e704dadaff67dcb177df17f" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 34295 } } peers { permanent_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 35529 } } peers { permanent_uuid: "9286e0d9badb45b2a4707e6abc774811" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42259 } }
I20260808 15:01:09.755939 11243 raft_consensus.cc:374] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:09.756047 11243 raft_consensus.cc:729] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70cb000f48c4212b9d2d8ffd35f7abf, State: Initialized, Role: FOLLOWER
I20260808 15:01:09.756639 11243 consensus_queue.cc:260] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1634cdd56e704dadaff67dcb177df17f" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 34295 } } peers { permanent_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 35529 } } peers { permanent_uuid: "9286e0d9badb45b2a4707e6abc774811" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42259 } }
I20260808 15:01:09.757145 11244 raft_consensus.cc:348] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1634cdd56e704dadaff67dcb177df17f" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 34295 } } peers { permanent_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 35529 } } peers { permanent_uuid: "9286e0d9badb45b2a4707e6abc774811" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42259 } }
I20260808 15:01:09.757623 11244 raft_consensus.cc:374] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:09.757730 11244 raft_consensus.cc:729] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9286e0d9badb45b2a4707e6abc774811, State: Initialized, Role: FOLLOWER
I20260808 15:01:09.757815 11210 heartbeater.cc:503] Master 127.12.73.190:43587 was elected leader, sending a full tablet report...
I20260808 15:01:09.758301 11244 consensus_queue.cc:260] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1634cdd56e704dadaff67dcb177df17f" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 34295 } } peers { permanent_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 35529 } } peers { permanent_uuid: "9286e0d9badb45b2a4707e6abc774811" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42259 } }
I20260808 15:01:09.758582 11243 ts_tablet_manager.cc:1428] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf: Time spent starting tablet: real 0.014s user 0.004s sys 0.011s
I20260808 15:01:09.760061 11244 ts_tablet_manager.cc:1428] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
W20260808 15:01:09.761772 10746 tablet.cc:2369] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:01:09.801259 11258 raft_consensus.cc:482] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:01:09.801609 11258 raft_consensus.cc:504] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1634cdd56e704dadaff67dcb177df17f" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 34295 } } peers { permanent_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 35529 } } peers { permanent_uuid: "9286e0d9badb45b2a4707e6abc774811" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42259 } }
I20260808 15:01:09.803436 11258 leader_election.cc:288] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1634cdd56e704dadaff67dcb177df17f (127.12.73.130:34295), 9286e0d9badb45b2a4707e6abc774811 (127.12.73.129:42259)
I20260808 15:01:09.810118 11214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.803737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:42259 (local address 127.12.73.131:49917)
0808 15:01:09.804306 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:09.804328 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:09.804486 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:09.804845 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:09.804871 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:09.804901 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:09.805101 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.805115 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.806336 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.806342 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.807958 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.807971 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.809492 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.809496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.809626 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.809650 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 15:01:09.809725 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 15:01:09.809816 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379}
I20260808 15:01:09.810170 11241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.804029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:49917 (local address 127.12.73.129:42259)
0808 15:01:09.804289 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:09.804298 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:09.804414 (+ 116us) server_negotiation.cc:407] Connection header received
0808 15:01:09.804646 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:09.804653 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:09.804745 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:09.804850 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:09.805271 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.806204 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.808173 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.809345 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.809514 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.809588 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:09.809787 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 15:01:09.809928 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 15:01:09.810745 11235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.803738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:52633 (local address 127.12.73.130:34295)
0808 15:01:09.803956 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:09.803964 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:09.804752 (+ 788us) server_negotiation.cc:407] Connection header received
0808 15:01:09.804940 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:09.804947 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:09.805026 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:09.805126 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:09.805760 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.806642 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.808547 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.809844 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.809991 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.810058 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:09.810461 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 15:01:09.810565 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:01:09.811275 11260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.803798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:34295 (local address 127.12.73.131:52633)
0808 15:01:09.804641 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:09.804657 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:09.804788 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:09.805148 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:09.805151 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:09.805215 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:09.805597 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.805611 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.806795 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.806799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.808386 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:09.808398 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.810064 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.810070 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:09.810251 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.810289 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 15:01:09.810952 (+ 663us) client_negotiation.cc:240] Negotiation successful
0808 15:01:09.811058 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":719,"thread_start_us":470,"threads_started":1}
I20260808 15:01:09.811275 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9232cbc7f1f54750a5c8f6b7724cba8c" candidate_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9286e0d9badb45b2a4707e6abc774811" is_pre_election: true
I20260808 15:01:09.811939 10665 raft_consensus.cc:2454] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70cb000f48c4212b9d2d8ffd35f7abf in term 0.
I20260808 15:01:09.812314 10892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9232cbc7f1f54750a5c8f6b7724cba8c" candidate_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1634cdd56e704dadaff67dcb177df17f" is_pre_election: true
I20260808 15:01:09.812722 11013 leader_election.cc:302] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9286e0d9badb45b2a4707e6abc774811, a70cb000f48c4212b9d2d8ffd35f7abf; no voters:
I20260808 15:01:09.812799 10892 raft_consensus.cc:2454] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70cb000f48c4212b9d2d8ffd35f7abf in term 0.
I20260808 15:01:09.813122 11258 raft_consensus.cc:2781] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:01:09.813306 11258 raft_consensus.cc:482] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:01:09.813468 11258 raft_consensus.cc:3037] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:09.816010 11258 raft_consensus.cc:504] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1634cdd56e704dadaff67dcb177df17f" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 34295 } } peers { permanent_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 35529 } } peers { permanent_uuid: "9286e0d9badb45b2a4707e6abc774811" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42259 } }
I20260808 15:01:09.816610 11258 leader_election.cc:288] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [CANDIDATE]: Term 1 election: Requested vote from peers 1634cdd56e704dadaff67dcb177df17f (127.12.73.130:34295), 9286e0d9badb45b2a4707e6abc774811 (127.12.73.129:42259)
I20260808 15:01:09.817070 10892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9232cbc7f1f54750a5c8f6b7724cba8c" candidate_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1634cdd56e704dadaff67dcb177df17f"
I20260808 15:01:09.817106 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9232cbc7f1f54750a5c8f6b7724cba8c" candidate_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9286e0d9badb45b2a4707e6abc774811"
I20260808 15:01:09.817317 10892 raft_consensus.cc:3037] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:09.817376 10665 raft_consensus.cc:3037] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:09.819585 10665 raft_consensus.cc:2454] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70cb000f48c4212b9d2d8ffd35f7abf in term 1.
I20260808 15:01:09.819587 10892 raft_consensus.cc:2454] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70cb000f48c4212b9d2d8ffd35f7abf in term 1.
I20260808 15:01:09.820008 11015 leader_election.cc:302] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1634cdd56e704dadaff67dcb177df17f, a70cb000f48c4212b9d2d8ffd35f7abf; no voters:
I20260808 15:01:09.820387 11258 raft_consensus.cc:2781] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:09.820876 11258 raft_consensus.cc:686] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 1 LEADER]: Becoming Leader. State: Replica: a70cb000f48c4212b9d2d8ffd35f7abf, State: Running, Role: LEADER
I20260808 15:01:09.821411 11258 consensus_queue.cc:237] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1634cdd56e704dadaff67dcb177df17f" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 34295 } } peers { permanent_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 35529 } } peers { permanent_uuid: "9286e0d9badb45b2a4707e6abc774811" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42259 } }
I20260808 15:01:09.826126 10399 catalog_manager.cc:5495] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf reported cstate change: term changed from 0 to 1, leader changed from <none> to a70cb000f48c4212b9d2d8ffd35f7abf (127.12.73.131). New cstate: current_term: 1 leader_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1634cdd56e704dadaff67dcb177df17f" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 34295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a70cb000f48c4212b9d2d8ffd35f7abf" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9286e0d9badb45b2a4707e6abc774811" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42259 } health_report { overall_health: UNKNOWN } } }
W20260808 15:01:09.832933 10972 tablet.cc:2369] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:01:09.858170 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.851862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45982 (local address 127.12.73.131:35529)
0808 15:01:09.852100 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:09.852104 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:09.852123 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:01:09.852311 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:09.852315 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:09.852402 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:09.852588 (+ 186us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:01:09.853014 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.853821 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.855822 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.856233 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.856325 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.856934 (+ 609us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:01:09.857511 (+ 577us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:01:09.857646 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:09.857826 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 15:01:09.857887 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 15:01:09.867281 10665 raft_consensus.cc:1261] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811 [term 1 FOLLOWER]: Refusing update from remote peer a70cb000f48c4212b9d2d8ffd35f7abf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:01:09.867282 10892 raft_consensus.cc:1261] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f [term 1 FOLLOWER]: Refusing update from remote peer a70cb000f48c4212b9d2d8ffd35f7abf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260808 15:01:09.868438 11212 tablet.cc:2369] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:01:09.868306 11264 consensus_queue.cc:1035] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9286e0d9badb45b2a4707e6abc774811" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:01:09.868747 11258 consensus_queue.cc:1035] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1634cdd56e704dadaff67dcb177df17f" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 34295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:01:09.893788 10400 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:01:09.894066 10400 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:01:09.897377 10400 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c6d7da7589f47a3a5ead42c8d92f459: Sending DeleteTablet for 3 replicas of tablet 9232cbc7f1f54750a5c8f6b7724cba8c
I20260808 15:01:09.898461 10865 tablet_service.cc:1514] Processing DeleteTablet for tablet 9232cbc7f1f54750a5c8f6b7724cba8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:09 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:34802
I20260808 15:01:09.898535 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 9232cbc7f1f54750a5c8f6b7724cba8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:09 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:45980
I20260808 15:01:09.898566 10628 tablet_service.cc:1514] Processing DeleteTablet for tablet 9232cbc7f1f54750a5c8f6b7724cba8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:09 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:59822
I20260808 15:01:09.904289 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 10517
I20260808 15:01:09.911073 11282 tablet_replica.cc:330] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f: stopping tablet replica
I20260808 15:01:09.911723 11284 tablet_replica.cc:330] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811: stopping tablet replica
I20260808 15:01:09.911972 11285 tablet_replica.cc:330] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf: stopping tablet replica
I20260808 15:01:09.912382 11284 raft_consensus.cc:2229] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:01:09.912405 11285 raft_consensus.cc:2229] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:01:09.912910 11282 raft_consensus.cc:2229] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:01:09.913067 11285 raft_consensus.cc:2258] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:09.913582 11284 raft_consensus.cc:2258] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:09.914084 11282 raft_consensus.cc:2258] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:09.915691 11285 ts_tablet_manager.cc:1905] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:09.916972 11284 ts_tablet_manager.cc:1905] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:09.917726 11282 ts_tablet_manager.cc:1905] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:09.923194 11285 ts_tablet_manager.cc:1918] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:09.923398 11285 log.cc:1196] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/9232cbc7f1f54750a5c8f6b7724cba8c
I20260808 15:01:09.923978 11285 ts_tablet_manager.cc:1939] T 9232cbc7f1f54750a5c8f6b7724cba8c P a70cb000f48c4212b9d2d8ffd35f7abf: Deleting consensus metadata
Aug 08 15:01:09 dist-test-slave-z8x9 krb5kdc[10311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 15:01:09.925570 11282 ts_tablet_manager.cc:1918] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:09.925843 11282 log.cc:1196] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/9232cbc7f1f54750a5c8f6b7724cba8c
I20260808 15:01:09.926488 11282 ts_tablet_manager.cc:1939] T 9232cbc7f1f54750a5c8f6b7724cba8c P 1634cdd56e704dadaff67dcb177df17f: Deleting consensus metadata
I20260808 15:01:09.926805 10363 catalog_manager.cc:4841] TS a70cb000f48c4212b9d2d8ffd35f7abf (127.12.73.131:35529): tablet 9232cbc7f1f54750a5c8f6b7724cba8c (table test-table [id=45e19b440ef44e969ee953040dac014b]) successfully deleted
I20260808 15:01:09.928623 10367 catalog_manager.cc:4841] TS 1634cdd56e704dadaff67dcb177df17f (127.12.73.130:34295): tablet 9232cbc7f1f54750a5c8f6b7724cba8c (table test-table [id=45e19b440ef44e969ee953040dac014b]) successfully deleted
I20260808 15:01:09.930330 11284 ts_tablet_manager.cc:1918] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:09.930512 11284 log.cc:1196] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/9232cbc7f1f54750a5c8f6b7724cba8c
I20260808 15:01:09.931090 11284 ts_tablet_manager.cc:1939] T 9232cbc7f1f54750a5c8f6b7724cba8c P 9286e0d9badb45b2a4707e6abc774811: Deleting consensus metadata
I20260808 15:01:09.932837 10365 catalog_manager.cc:4841] TS 9286e0d9badb45b2a4707e6abc774811 (127.12.73.129:42259): tablet 9232cbc7f1f54750a5c8f6b7724cba8c (table test-table [id=45e19b440ef44e969ee953040dac014b]) successfully deleted
I20260808 15:01:09.934605 11241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:09.906223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59836 (local address 127.12.73.129:42259)
0808 15:01:09.906400 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:09.906406 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:09.907826 (+ 1420us) server_negotiation.cc:407] Connection header received
0808 15:01:09.908395 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:09.908402 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:09.908485 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:09.908586 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:09.913516 (+ 4930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.914724 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.916621 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:09.917308 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:09.917409 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:09.927492 (+ 10083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:09.927506 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:09.927525 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:09.927573 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:09.931420 (+ 3847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:09.932173 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:09.932180 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:09.932182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:09.932339 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:09.932791 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:09.932796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:09.932800 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:09.933261 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:09.933498 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:09.934034 (+ 536us) server_negotiation.cc:299] Negotiation successful
0808 15:01:09.934264 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:01:09.935274 10736 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:10.059713 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 10517
I20260808 15:01:10.086992 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 10760
Aug 08 15:01:10 dist-test-slave-z8x9 krb5kdc[10311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 15:01:10.107365 11235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:10.087873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34818 (local address 127.12.73.130:34295)
0808 15:01:10.088061 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:10.088067 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:10.088089 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:01:10.088164 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:10.088169 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:10.088248 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:10.088367 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:10.090142 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:10.091340 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:10.093217 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:10.093870 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:10.094007 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:10.099661 (+ 5654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:10.099675 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:10.099694 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:10.099750 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:10.103803 (+ 4053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:10.104674 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:10.104683 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:10.104688 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:10.104854 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:10.105372 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:10.105377 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:10.105380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:10.105859 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:10.106172 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:10.106485 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 15:01:10.106782 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 15:01:10.108091 10962 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:10.200791 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 10760
I20260808 15:01:10.228539 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 10985
Aug 08 15:01:10 dist-test-slave-z8x9 krb5kdc[10311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 15:01:10.247637 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:10.229431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45992 (local address 127.12.73.131:35529)
0808 15:01:10.229616 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:10.229621 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:10.229732 (+ 111us) server_negotiation.cc:407] Connection header received
0808 15:01:10.229909 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:10.229913 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:10.229992 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:10.230077 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:10.231796 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:10.232634 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:10.234670 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:10.235117 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:10.235221 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:10.241365 (+ 6144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:10.241379 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:10.241395 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:10.241432 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:10.244572 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:10.245505 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:10.245512 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:10.245515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:10.245667 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:10.246110 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:10.246113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:10.246115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:10.246494 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:10.246744 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:10.247101 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 15:01:10.247279 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 15:01:10.248378 11202 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:10.376927 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 10985
I20260808 15:01:10.406595 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 10339
I20260808 15:01:10.407702 10453 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:10.520095 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 10339
2026-08-08T15:01:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4789 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T15:01:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:10Z Disabled control of system clock
I20260808 15:01:10.622345 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:44997
--webserver_interface=127.12.73.190
--webserver_port=0
--builtin_ntp_servers=127.12.73.148:36869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:44997
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 15:01:10.965808 11306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:10.966120 11306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:10.966266 11306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:10.973848 11306 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:10.973948 11306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:10.974041 11306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:10.974148 11306 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:10.974239 11306 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:10.983630 11306 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:36869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:44997
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:44997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:10.984865 11306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:10.986639 11306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:10.998697 11314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:10.998780 11315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:10.998811 11320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:10.999650 11306 server_base.cc:1034] running on GCE node
I20260808 15:01:11.000429 11306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:11.001869 11306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:11.003083 11306 hybrid_clock.cc:648] HybridClock initialized: now 1786201271003034 us; error 33 us; skew 500 ppm
I20260808 15:01:11.003422 11306 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 15:01:11.005730 11306 webserver.cc:460] Webserver started at http://127.12.73.190:36817/ using document root <none> and password file <none>
I20260808 15:01:11.006390 11306 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:11.006479 11306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:11.006747 11306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:11.009704 11306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "a772b6af26f64d13bfbca0598bb375f1"
format_stamp: "Formatted at 2026-08-08 15:01:11 on dist-test-slave-z8x9"
server_key: "10ac119b1cbbb441bc582d50cbb93b9c"
server_key_iv: "a000864cc7bfe315600fa22b5250c62f"
server_key_version: "encryptionkey@0"
I20260808 15:01:11.010473 11306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "a772b6af26f64d13bfbca0598bb375f1"
format_stamp: "Formatted at 2026-08-08 15:01:11 on dist-test-slave-z8x9"
server_key: "10ac119b1cbbb441bc582d50cbb93b9c"
server_key_iv: "a000864cc7bfe315600fa22b5250c62f"
server_key_version: "encryptionkey@0"
I20260808 15:01:11.015894 11306 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 15:01:11.019430 11337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:11.020780 11306 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:01:11.020925 11306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "a772b6af26f64d13bfbca0598bb375f1"
format_stamp: "Formatted at 2026-08-08 15:01:11 on dist-test-slave-z8x9"
server_key: "10ac119b1cbbb441bc582d50cbb93b9c"
server_key_iv: "a000864cc7bfe315600fa22b5250c62f"
server_key_version: "encryptionkey@0"
I20260808 15:01:11.021103 11306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:11.033052 11306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:11.033838 11306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:11.034106 11306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:11.052662 11306 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:44997
I20260808 15:01:11.052690 11436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:44997 every 8 connection(s)
I20260808 15:01:11.053988 11306 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:11.057593 11437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:11.060657 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 11306
I20260808 15:01:11.060858 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:11.061463 12582 external_mini_cluster.cc:1428] Setting key 3a863bb136919e6b9672077ae19311b6
I20260808 15:01:11.069435 11437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1: Bootstrap starting.
I20260808 15:01:11.072562 11437 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:11.073807 11437 log.cc:824] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:11.075305 11445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:11.063479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43540 (local address 127.12.73.190:44997)
0808 15:01:11.064353 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:11.064363 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:11.064402 (+ 39us) server_negotiation.cc:407] Connection header received
0808 15:01:11.066107 (+ 1705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:11.066129 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:11.066588 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:11.066970 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:11.067551 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:11.068781 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:11.070221 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:11.070903 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:11.071124 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:11.072354 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:11.072361 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:11.072373 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:11.072943 (+ 570us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:11.073057 (+ 114us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:11.073076 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:11.073239 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:11.073446 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 15:01:11.073985 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":324,"threads_started":1}
I20260808 15:01:11.077062 11437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1: No bootstrap required, opened a new log
I20260808 15:01:11.084409 11437 raft_consensus.cc:348] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a772b6af26f64d13bfbca0598bb375f1" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 44997 } }
I20260808 15:01:11.084775 11437 raft_consensus.cc:374] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:11.084887 11437 raft_consensus.cc:729] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a772b6af26f64d13bfbca0598bb375f1, State: Initialized, Role: FOLLOWER
I20260808 15:01:11.085489 11437 consensus_queue.cc:260] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a772b6af26f64d13bfbca0598bb375f1" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 44997 } }
I20260808 15:01:11.085739 11437 raft_consensus.cc:388] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:11.085881 11437 raft_consensus.cc:482] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:11.086055 11437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:11.088485 11437 raft_consensus.cc:504] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a772b6af26f64d13bfbca0598bb375f1" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 44997 } }
I20260808 15:01:11.088963 11437 leader_election.cc:302] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a772b6af26f64d13bfbca0598bb375f1; no voters:
I20260808 15:01:11.089581 11437 leader_election.cc:288] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:11.089748 11447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:11.090562 11447 raft_consensus.cc:686] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [term 1 LEADER]: Becoming Leader. State: Replica: a772b6af26f64d13bfbca0598bb375f1, State: Running, Role: LEADER
I20260808 15:01:11.091148 11447 consensus_queue.cc:237] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a772b6af26f64d13bfbca0598bb375f1" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 44997 } }
I20260808 15:01:11.091674 11437 sys_catalog.cc:564] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:11.094316 11450 sys_catalog.cc:455] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a772b6af26f64d13bfbca0598bb375f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a772b6af26f64d13bfbca0598bb375f1" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 44997 } } }
I20260808 15:01:11.094291 11452 sys_catalog.cc:455] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a772b6af26f64d13bfbca0598bb375f1. Latest consensus state: current_term: 1 leader_uuid: "a772b6af26f64d13bfbca0598bb375f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a772b6af26f64d13bfbca0598bb375f1" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 44997 } } }
I20260808 15:01:11.094818 11450 sys_catalog.cc:458] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:11.094818 11452 sys_catalog.cc:458] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:11.096873 11464 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:11.102219 11464 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:11.111598 11464 catalog_manager.cc:1347] Generated new cluster ID: 786adf18d48140dea8249dcbdd781f83
I20260808 15:01:11.111725 11464 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:11.131139 11464 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:11.132349 11464 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:11.144197 11464 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1: Generated new TSK 0
I20260808 15:01:11.145016 11464 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:11.158246 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:44997
--builtin_ntp_servers=127.12.73.148:36869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 15:01:11.498323 11480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:11.498617 11480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:11.498776 11480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:11.505923 11480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:11.506019 11480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:11.506122 11480 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 15:01:11.515035 11480 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:36869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:44997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:11.516207 11480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:11.518009 11480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:11.531462 11493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:11.531533 11497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:11.531508 11494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:11.532222 11480 server_base.cc:1034] running on GCE node
I20260808 15:01:11.532902 11480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:11.533911 11480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:11.535148 11480 hybrid_clock.cc:648] HybridClock initialized: now 1786201271535089 us; error 68 us; skew 500 ppm
I20260808 15:01:11.535488 11480 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 15:01:11.538069 11480 webserver.cc:460] Webserver started at http://127.12.73.129:32843/ using document root <none> and password file <none>
I20260808 15:01:11.538797 11480 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:11.538938 11480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:11.539268 11480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:11.542243 11480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "a56a67eac0be48bcad7d5c194ed28dfa"
format_stamp: "Formatted at 2026-08-08 15:01:11 on dist-test-slave-z8x9"
server_key: "504cde7d1574532ac74a20e8a67bddfd"
server_key_iv: "4a0617f98c75800c4b770826d93bd68b"
server_key_version: "encryptionkey@0"
I20260808 15:01:11.543063 11480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "a56a67eac0be48bcad7d5c194ed28dfa"
format_stamp: "Formatted at 2026-08-08 15:01:11 on dist-test-slave-z8x9"
server_key: "504cde7d1574532ac74a20e8a67bddfd"
server_key_iv: "4a0617f98c75800c4b770826d93bd68b"
server_key_version: "encryptionkey@0"
I20260808 15:01:11.548190 11480 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 15:01:11.551651 11503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:11.552959 11480 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:01:11.553143 11480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "a56a67eac0be48bcad7d5c194ed28dfa"
format_stamp: "Formatted at 2026-08-08 15:01:11 on dist-test-slave-z8x9"
server_key: "504cde7d1574532ac74a20e8a67bddfd"
server_key_iv: "4a0617f98c75800c4b770826d93bd68b"
server_key_version: "encryptionkey@0"
I20260808 15:01:11.553426 11480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:11.563786 11480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:11.564554 11480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:11.564869 11480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:11.565934 11480 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:11.567351 11480 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:11.567476 11480 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:11.567617 11480 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:11.567711 11480 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:11.603453 11480 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:34445
I20260808 15:01:11.603545 11687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:34445 every 8 connection(s)
I20260808 15:01:11.604808 11480 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 15:01:11.610724 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 11480
I20260808 15:01:11.610936 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 15:01:11.611390 12582 external_mini_cluster.cc:1428] Setting key 7a66f4573f5e7900ed600ac28c51f7d7
I20260808 15:01:11.614497 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:44997
--builtin_ntp_servers=127.12.73.148:36869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 15:01:11.618839 11693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:11.607451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:45729 (local address 127.12.73.190:44997)
0808 15:01:11.607913 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:11.607919 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:11.609082 (+ 1163us) server_negotiation.cc:407] Connection header received
0808 15:01:11.610909 (+ 1827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:11.610915 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:11.611014 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:11.611164 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:11.612343 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:11.613436 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:11.615879 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:11.616260 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:11.616362 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:11.618060 (+ 1698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:11.618065 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:11.618068 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:11.618086 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:11.618135 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:11.618147 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:11.618219 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:11.618514 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 15:01:11.618587 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":220,"threads_started":1}
I20260808 15:01:11.620308 11694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:11.608038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:44997 (local address 127.12.73.129:45729)
0808 15:01:11.608927 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:11.608969 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:11.610634 (+ 1665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:11.611394 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:11.611403 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:11.611515 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:11.612130 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:11.612154 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:11.613609 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:11.613614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:11.615736 (+ 2122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:11.615755 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:11.616499 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:11.616509 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:11.616861 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:11.617696 (+ 835us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:01:11.617702 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:11.617759 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:01:11.617873 (+ 114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:11.618255 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:11.618268 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:11.618279 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 15:01:11.618499 (+ 220us) client_negotiation.cc:240] Negotiation successful
0808 15:01:11.618911 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":266,"threads_started":1}
I20260808 15:01:11.621943 11689 heartbeater.cc:347] Connected to a master server at 127.12.73.190:44997
I20260808 15:01:11.622267 11689 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:11.623013 11689 heartbeater.cc:511] Master 127.12.73.190:44997 requested a full tablet report, sending...
I20260808 15:01:11.625074 11377 ts_manager.cc:194] Registered new tserver with Master: a56a67eac0be48bcad7d5c194ed28dfa (127.12.73.129:34445)
I20260808 15:01:11.626642 11377 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.73.129:45729
W20260808 15:01:11.958467 11696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:11.958753 11696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:11.958913 11696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:11.966216 11696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:11.966324 11696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:11.966504 11696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 15:01:11.975965 11696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:36869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:44997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:11.977392 11696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:11.979213 11696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:11.992321 11707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:11.992385 11703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:11.992406 11702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:11.993500 11696 server_base.cc:1034] running on GCE node
I20260808 15:01:11.994112 11696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:11.995143 11696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:11.996356 11696 hybrid_clock.cc:648] HybridClock initialized: now 1786201271996320 us; error 34 us; skew 500 ppm
I20260808 15:01:11.996678 11696 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 15:01:11.999081 11696 webserver.cc:460] Webserver started at http://127.12.73.130:38057/ using document root <none> and password file <none>
I20260808 15:01:11.999799 11696 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:11.999920 11696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:12.000283 11696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:12.003237 11696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "892b578c14d043aba79c2415fe423ee3"
format_stamp: "Formatted at 2026-08-08 15:01:11 on dist-test-slave-z8x9"
server_key: "34ad598a5258b83226415eb4f5ae593e"
server_key_iv: "11c11118ead4212020721f9f82c49d95"
server_key_version: "encryptionkey@0"
I20260808 15:01:12.004030 11696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "892b578c14d043aba79c2415fe423ee3"
format_stamp: "Formatted at 2026-08-08 15:01:11 on dist-test-slave-z8x9"
server_key: "34ad598a5258b83226415eb4f5ae593e"
server_key_iv: "11c11118ead4212020721f9f82c49d95"
server_key_version: "encryptionkey@0"
I20260808 15:01:12.009305 11696 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260808 15:01:12.012669 11715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:12.013999 11696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:01:12.014202 11696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "892b578c14d043aba79c2415fe423ee3"
format_stamp: "Formatted at 2026-08-08 15:01:11 on dist-test-slave-z8x9"
server_key: "34ad598a5258b83226415eb4f5ae593e"
server_key_iv: "11c11118ead4212020721f9f82c49d95"
server_key_version: "encryptionkey@0"
I20260808 15:01:12.014415 11696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:12.032711 11696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:12.033610 11696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:12.033941 11696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:12.034950 11696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:12.036434 11696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:12.036523 11696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:12.036682 11696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:12.036779 11696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:12.071120 11696 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:40519
I20260808 15:01:12.071133 11926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:40519 every 8 connection(s)
I20260808 15:01:12.072685 11696 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 15:01:12.078270 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 11696
I20260808 15:01:12.078459 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 15:01:12.078943 12582 external_mini_cluster.cc:1428] Setting key 1e8773a0787292180c6b749edf847314
I20260808 15:01:12.081797 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:44997
--builtin_ntp_servers=127.12.73.148:36869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 15:01:12.085959 11693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.075387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:46821 (local address 127.12.73.190:44997)
0808 15:01:12.075593 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:12.075599 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:12.077241 (+ 1642us) server_negotiation.cc:407] Connection header received
0808 15:01:12.079206 (+ 1965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:12.079212 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:12.079302 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:12.079410 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:12.080580 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.081383 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.083058 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.083479 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.083633 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.085075 (+ 1442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:12.085080 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:12.085083 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:12.085100 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:12.085145 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:12.085164 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:12.085299 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:12.085545 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 15:01:12.085655 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:01:12.086977 11930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.075958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:44997 (local address 127.12.73.130:46821)
0808 15:01:12.077038 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:12.077084 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:12.078886 (+ 1802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:12.079689 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:12.079702 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:12.079815 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:12.080412 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.080428 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.081540 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.081552 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.082902 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.082914 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.083736 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.083744 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.083979 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.084750 (+ 771us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:01:12.084753 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:12.084792 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:01:12.084874 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:12.085325 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:12.085341 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:12.085347 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 15:01:12.085520 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 15:01:12.085929 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":369,"threads_started":1}
I20260808 15:01:12.088534 11927 heartbeater.cc:347] Connected to a master server at 127.12.73.190:44997
I20260808 15:01:12.088872 11927 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:12.089733 11927 heartbeater.cc:511] Master 127.12.73.190:44997 requested a full tablet report, sending...
I20260808 15:01:12.091250 11377 ts_manager.cc:194] Registered new tserver with Master: 892b578c14d043aba79c2415fe423ee3 (127.12.73.130:40519)
I20260808 15:01:12.092500 11377 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.73.130:46821
W20260808 15:01:12.424966 11932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:12.425325 11932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:12.425493 11932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:12.432626 11932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:12.432755 11932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:12.432925 11932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 15:01:12.441833 11932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:36869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:44997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:12.443131 11932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:12.444898 11932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:12.458043 11943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:12.458211 11940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:12.458177 11938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:12.459205 11932 server_base.cc:1034] running on GCE node
I20260808 15:01:12.459743 11932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:12.460593 11932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:12.461826 11932 hybrid_clock.cc:648] HybridClock initialized: now 1786201272461784 us; error 59 us; skew 500 ppm
I20260808 15:01:12.462157 11932 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 15:01:12.464437 11932 webserver.cc:460] Webserver started at http://127.12.73.131:35185/ using document root <none> and password file <none>
I20260808 15:01:12.465142 11932 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:12.465327 11932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:12.465658 11932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:12.468503 11932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "996bc5e1cd8448589cb193598654a1d2"
format_stamp: "Formatted at 2026-08-08 15:01:12 on dist-test-slave-z8x9"
server_key: "45249ba27242c7bdd4a4c8073f59be2c"
server_key_iv: "73f134efcab85da28986d5442f49db53"
server_key_version: "encryptionkey@0"
I20260808 15:01:12.469385 11932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "996bc5e1cd8448589cb193598654a1d2"
format_stamp: "Formatted at 2026-08-08 15:01:12 on dist-test-slave-z8x9"
server_key: "45249ba27242c7bdd4a4c8073f59be2c"
server_key_iv: "73f134efcab85da28986d5442f49db53"
server_key_version: "encryptionkey@0"
I20260808 15:01:12.474452 11932 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 15:01:12.478050 11952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:12.479326 11932 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:01:12.479513 11932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "996bc5e1cd8448589cb193598654a1d2"
format_stamp: "Formatted at 2026-08-08 15:01:12 on dist-test-slave-z8x9"
server_key: "45249ba27242c7bdd4a4c8073f59be2c"
server_key_iv: "73f134efcab85da28986d5442f49db53"
server_key_version: "encryptionkey@0"
I20260808 15:01:12.479727 11932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:12.499002 11932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:12.499795 11932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:12.500126 11932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:12.501098 11932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:12.502604 11932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:12.502734 11932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:12.502872 11932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:12.502959 11932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:12.537243 11932 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:33409
I20260808 15:01:12.537340 12172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:33409 every 8 connection(s)
I20260808 15:01:12.538589 11932 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 15:01:12.545229 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 11932
I20260808 15:01:12.545435 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 15:01:12.545886 12582 external_mini_cluster.cc:1428] Setting key 6f0eb1885868ed97fe8ee22d15739406
I20260808 15:01:12.551234 11693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.541093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:33037 (local address 127.12.73.190:44997)
0808 15:01:12.541317 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:12.541322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:12.542709 (+ 1387us) server_negotiation.cc:407] Connection header received
0808 15:01:12.544511 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:12.544517 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:12.544615 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:12.544727 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:12.545977 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.546781 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.548380 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.548826 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.548971 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.550367 (+ 1396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:12.550372 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:12.550375 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:12.550393 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:12.550426 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:12.550438 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:12.550538 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:12.550774 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 15:01:12.550881 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260808 15:01:12.552279 12177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.541656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:44997 (local address 127.12.73.131:33037)
0808 15:01:12.542552 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:12.542587 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:12.544234 (+ 1647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:12.544961 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:12.544969 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:12.545053 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:12.545802 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.545821 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.546965 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.546970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.548221 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.548233 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.549060 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.549067 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.549379 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.550038 (+ 659us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:01:12.550040 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:12.550082 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:01:12.550164 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:12.550540 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:12.550555 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:12.550564 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 15:01:12.550746 (+ 182us) client_negotiation.cc:240] Negotiation successful
0808 15:01:12.551144 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":277,"threads_started":1}
I20260808 15:01:12.553733 12175 heartbeater.cc:347] Connected to a master server at 127.12.73.190:44997
I20260808 15:01:12.554006 12175 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:12.554744 12175 heartbeater.cc:511] Master 127.12.73.190:44997 requested a full tablet report, sending...
I20260808 15:01:12.556116 11377 ts_manager.cc:194] Registered new tserver with Master: 996bc5e1cd8448589cb193598654a1d2 (127.12.73.131:33409)
I20260808 15:01:12.556867 11377 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.73.131:33037
I20260808 15:01:12.560941 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:01:12.570901 11693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.565067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43820 (local address 127.12.73.190:44997)
0808 15:01:12.565297 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:12.565305 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:12.565834 (+ 529us) server_negotiation.cc:407] Connection header received
0808 15:01:12.565967 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:12.565971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:12.566028 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:12.566108 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:12.566589 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.567303 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.568631 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.569046 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.569138 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.570296 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:12.570301 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:12.570304 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:12.570322 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:12.570355 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:12.570367 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:12.570487 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:12.570645 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 15:01:12.570690 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 15:01:12.574643 11377 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43820:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:01:12.581702 11377 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:01:12.604773 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.594500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:34445 (local address 127.0.0.1:36214)
0808 15:01:12.595217 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:12.595255 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:12.595383 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:12.596602 (+ 1219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:12.596613 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:12.596665 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:12.597290 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.597307 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.599489 (+ 2182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.599494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.601819 (+ 2325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.601833 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.603854 (+ 2021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.603860 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.604056 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.604115 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 15:01:12.604238 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 15:01:12.604436 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":377,"threads_started":1}
I20260808 15:01:12.606186 12197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.595851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:33409 (local address 127.0.0.1:42218)
0808 15:01:12.596843 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:12.596862 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:12.596991 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:12.598638 (+ 1647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:12.598645 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:12.598675 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:12.599101 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.599113 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.601012 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.601020 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.603236 (+ 2216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.603250 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.605455 (+ 2205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.605462 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.605646 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.605679 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 15:01:12.605767 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 15:01:12.605889 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":814,"thread_start_us":683,"threads_started":1}
I20260808 15:01:12.606528 12196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.594737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36214 (local address 127.12.73.129:34445)
0808 15:01:12.595907 (+ 1170us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:12.595916 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:12.595947 (+ 31us) server_negotiation.cc:407] Connection header received
0808 15:01:12.596049 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:12.596058 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:12.596325 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:12.597243 (+ 918us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:12.597577 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.599337 (+ 1760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.602075 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.603623 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.605541 (+ 1918us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.605836 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:12.605909 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 15:01:12.606098 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":975,"thread_start_us":847,"threads_started":1}
I20260808 15:01:12.607214 12203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.597577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:40519 (local address 127.0.0.1:36300)
0808 15:01:12.598242 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:12.598258 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:12.598371 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:12.599696 (+ 1325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:12.599702 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:12.599730 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:12.600160 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.600175 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.602068 (+ 1893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.602073 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.604217 (+ 2144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.604232 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.606389 (+ 2157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.606395 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.606596 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.606641 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 15:01:12.606739 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 15:01:12.606867 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":1,"thread_start_us":430,"threads_started":1}
I20260808 15:01:12.607263 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.596260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42218 (local address 127.12.73.131:33409)
0808 15:01:12.598023 (+ 1763us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:12.598033 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:12.598070 (+ 37us) server_negotiation.cc:407] Connection header received
0808 15:01:12.598165 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:12.598173 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:12.598387 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:12.599264 (+ 877us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:12.599556 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.600887 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.603465 (+ 2578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.604888 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.605011 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.605307 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:12.606732 (+ 1425us) server_negotiation.cc:299] Negotiation successful
0808 15:01:12.606901 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1577,"thread_start_us":1428,"threads_started":1}
I20260808 15:01:12.609118 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.597241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36300 (local address 127.12.73.130:40519)
0808 15:01:12.598876 (+ 1635us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:12.598885 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:12.598914 (+ 29us) server_negotiation.cc:407] Connection header received
0808 15:01:12.599015 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:12.599023 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:12.599249 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:12.599451 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:12.600369 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.601911 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.604427 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.605919 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.606045 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.606262 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:12.607585 (+ 1323us) server_negotiation.cc:299] Negotiation successful
0808 15:01:12.607772 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1469,"thread_start_us":1330,"threads_started":1}
I20260808 15:01:12.610855 12043 tablet_service.cc:1467] Processing CreateTablet for tablet 495b9e41289142eb9174ddeb7d2e7dc3 (DEFAULT_TABLE table=test-table [id=2b0d6d86b76e4b388214cc2be7671679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:12.610858 11583 tablet_service.cc:1467] Processing CreateTablet for tablet 495b9e41289142eb9174ddeb7d2e7dc3 (DEFAULT_TABLE table=test-table [id=2b0d6d86b76e4b388214cc2be7671679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:12.612406 11583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 495b9e41289142eb9174ddeb7d2e7dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:12.612397 12043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 495b9e41289142eb9174ddeb7d2e7dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:12.612217 11804 tablet_service.cc:1467] Processing CreateTablet for tablet 495b9e41289142eb9174ddeb7d2e7dc3 (DEFAULT_TABLE table=test-table [id=2b0d6d86b76e4b388214cc2be7671679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:12.613560 11804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 495b9e41289142eb9174ddeb7d2e7dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:12.626140 12204 tablet_bootstrap.cc:492] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3: Bootstrap starting.
I20260808 15:01:12.629254 12204 tablet_bootstrap.cc:654] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:12.630089 11689 heartbeater.cc:503] Master 127.12.73.190:44997 was elected leader, sending a full tablet report...
I20260808 15:01:12.630605 12204 log.cc:824] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:12.631657 12207 tablet_bootstrap.cc:492] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2: Bootstrap starting.
I20260808 15:01:12.632898 12206 tablet_bootstrap.cc:492] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa: Bootstrap starting.
I20260808 15:01:12.634907 12204 tablet_bootstrap.cc:492] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3: No bootstrap required, opened a new log
I20260808 15:01:12.635218 12207 tablet_bootstrap.cc:654] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:12.635254 12204 ts_tablet_manager.cc:1397] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20260808 15:01:12.636153 12206 tablet_bootstrap.cc:654] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:12.636550 12207 log.cc:824] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:12.637148 12206 log.cc:824] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:12.639842 12207 tablet_bootstrap.cc:492] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2: No bootstrap required, opened a new log
I20260808 15:01:12.640120 12207 ts_tablet_manager.cc:1397] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260808 15:01:12.640200 12206 tablet_bootstrap.cc:492] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa: No bootstrap required, opened a new log
I20260808 15:01:12.640496 12206 ts_tablet_manager.cc:1397] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.007s
I20260808 15:01:12.643846 12204 raft_consensus.cc:348] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34445 } } peers { permanent_uuid: "996bc5e1cd8448589cb193598654a1d2" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 33409 } } peers { permanent_uuid: "892b578c14d043aba79c2415fe423ee3" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 40519 } }
I20260808 15:01:12.644238 12204 raft_consensus.cc:374] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:12.644344 12204 raft_consensus.cc:729] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 892b578c14d043aba79c2415fe423ee3, State: Initialized, Role: FOLLOWER
I20260808 15:01:12.644961 12204 consensus_queue.cc:260] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34445 } } peers { permanent_uuid: "996bc5e1cd8448589cb193598654a1d2" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 33409 } } peers { permanent_uuid: "892b578c14d043aba79c2415fe423ee3" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 40519 } }
I20260808 15:01:12.646062 11927 heartbeater.cc:503] Master 127.12.73.190:44997 was elected leader, sending a full tablet report...
I20260808 15:01:12.646749 12204 ts_tablet_manager.cc:1428] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3: Time spent starting tablet: real 0.011s user 0.009s sys 0.002s
I20260808 15:01:12.650902 12206 raft_consensus.cc:348] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34445 } } peers { permanent_uuid: "996bc5e1cd8448589cb193598654a1d2" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 33409 } } peers { permanent_uuid: "892b578c14d043aba79c2415fe423ee3" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 40519 } }
I20260808 15:01:12.650854 12207 raft_consensus.cc:348] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34445 } } peers { permanent_uuid: "996bc5e1cd8448589cb193598654a1d2" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 33409 } } peers { permanent_uuid: "892b578c14d043aba79c2415fe423ee3" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 40519 } }
I20260808 15:01:12.651314 12206 raft_consensus.cc:374] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:12.651319 12207 raft_consensus.cc:374] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:12.651425 12207 raft_consensus.cc:729] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 996bc5e1cd8448589cb193598654a1d2, State: Initialized, Role: FOLLOWER
I20260808 15:01:12.651425 12206 raft_consensus.cc:729] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a56a67eac0be48bcad7d5c194ed28dfa, State: Initialized, Role: FOLLOWER
I20260808 15:01:12.652032 12206 consensus_queue.cc:260] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34445 } } peers { permanent_uuid: "996bc5e1cd8448589cb193598654a1d2" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 33409 } } peers { permanent_uuid: "892b578c14d043aba79c2415fe423ee3" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 40519 } }
I20260808 15:01:12.652047 12207 consensus_queue.cc:260] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34445 } } peers { permanent_uuid: "996bc5e1cd8448589cb193598654a1d2" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 33409 } } peers { permanent_uuid: "892b578c14d043aba79c2415fe423ee3" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 40519 } }
I20260808 15:01:12.653859 12206 ts_tablet_manager.cc:1428] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
I20260808 15:01:12.653934 12175 heartbeater.cc:503] Master 127.12.73.190:44997 was elected leader, sending a full tablet report...
I20260808 15:01:12.654136 12207 ts_tablet_manager.cc:1428] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2: Time spent starting tablet: real 0.014s user 0.004s sys 0.011s
W20260808 15:01:12.790351 12176 tablet.cc:2369] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:01:12.824906 11929 tablet.cc:2369] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:01:12.858210 11690 tablet.cc:2369] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:01:12.983394 12216 raft_consensus.cc:482] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:01:12.983688 12216 raft_consensus.cc:504] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34445 } } peers { permanent_uuid: "996bc5e1cd8448589cb193598654a1d2" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 33409 } } peers { permanent_uuid: "892b578c14d043aba79c2415fe423ee3" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 40519 } }
I20260808 15:01:12.985594 12216 leader_election.cc:288] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 996bc5e1cd8448589cb193598654a1d2 (127.12.73.131:33409), 892b578c14d043aba79c2415fe423ee3 (127.12.73.130:40519)
I20260808 15:01:12.992298 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.985935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:56769 (local address 127.12.73.131:33409)
0808 15:01:12.986140 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:12.986148 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:12.986791 (+ 643us) server_negotiation.cc:407] Connection header received
0808 15:01:12.987079 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:12.987089 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:12.987196 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:12.987305 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:12.987994 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.988721 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.990609 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.991348 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.991531 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.991606 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:12.991869 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 15:01:12.991998 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 15:01:12.992405 12220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.986036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:33409 (local address 127.12.73.129:56769)
0808 15:01:12.986664 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:12.986681 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:12.986881 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:12.987356 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:12.987364 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:12.987400 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:12.987840 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.987860 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.988854 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.988862 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.990416 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.990429 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.991531 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.991537 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.991703 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.991726 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:01:12.991831 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 15:01:12.991953 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":354,"threads_started":1}
I20260808 15:01:12.993074 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.986983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:36619 (local address 127.12.73.130:40519)
0808 15:01:12.987186 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:12.987193 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:12.987663 (+ 470us) server_negotiation.cc:407] Connection header received
0808 15:01:12.987828 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:12.987831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:12.987902 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:12.988044 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:12.988774 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.989549 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.991273 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.992014 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.992190 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.992277 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:12.992660 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 15:01:12.992816 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 15:01:12.993731 12222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:12.986810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:40519 (local address 127.12.73.129:36619)
0808 15:01:12.987548 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:12.987570 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:12.987702 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:12.988224 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:12.988229 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:12.988255 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:12.988605 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.988614 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.989691 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.989700 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.991096 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:12.991108 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:12.992228 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:12.992235 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:12.992459 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:12.992517 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 15:01:12.993297 (+ 780us) client_negotiation.cc:240] Negotiation successful
0808 15:01:12.993439 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":376,"threads_started":1}
I20260808 15:01:12.993528 12075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "495b9e41289142eb9174ddeb7d2e7dc3" candidate_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996bc5e1cd8448589cb193598654a1d2" is_pre_election: true
I20260808 15:01:12.994120 12075 raft_consensus.cc:2454] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a56a67eac0be48bcad7d5c194ed28dfa in term 0.
I20260808 15:01:12.994751 11507 leader_election.cc:302] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 996bc5e1cd8448589cb193598654a1d2, a56a67eac0be48bcad7d5c194ed28dfa; no voters:
I20260808 15:01:12.994776 11845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "495b9e41289142eb9174ddeb7d2e7dc3" candidate_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "892b578c14d043aba79c2415fe423ee3" is_pre_election: true
I20260808 15:01:12.995198 12216 raft_consensus.cc:2781] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:01:12.995324 11845 raft_consensus.cc:2454] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a56a67eac0be48bcad7d5c194ed28dfa in term 0.
I20260808 15:01:12.995376 12216 raft_consensus.cc:482] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:01:12.995496 12216 raft_consensus.cc:3037] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:12.998278 12216 raft_consensus.cc:504] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34445 } } peers { permanent_uuid: "996bc5e1cd8448589cb193598654a1d2" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 33409 } } peers { permanent_uuid: "892b578c14d043aba79c2415fe423ee3" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 40519 } }
I20260808 15:01:12.999284 12216 leader_election.cc:288] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [CANDIDATE]: Term 1 election: Requested vote from peers 996bc5e1cd8448589cb193598654a1d2 (127.12.73.131:33409), 892b578c14d043aba79c2415fe423ee3 (127.12.73.130:40519)
I20260808 15:01:12.999615 12075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "495b9e41289142eb9174ddeb7d2e7dc3" candidate_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "996bc5e1cd8448589cb193598654a1d2"
I20260808 15:01:12.999720 11845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "495b9e41289142eb9174ddeb7d2e7dc3" candidate_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "892b578c14d043aba79c2415fe423ee3"
I20260808 15:01:12.999840 12075 raft_consensus.cc:3037] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:12.999948 11845 raft_consensus.cc:3037] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:13.002355 11845 raft_consensus.cc:2454] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a56a67eac0be48bcad7d5c194ed28dfa in term 1.
I20260808 15:01:13.002351 12075 raft_consensus.cc:2454] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a56a67eac0be48bcad7d5c194ed28dfa in term 1.
I20260808 15:01:13.002748 11507 leader_election.cc:302] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 892b578c14d043aba79c2415fe423ee3, a56a67eac0be48bcad7d5c194ed28dfa; no voters:
I20260808 15:01:13.003042 12216 raft_consensus.cc:2781] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:13.003490 12216 raft_consensus.cc:686] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 1 LEADER]: Becoming Leader. State: Replica: a56a67eac0be48bcad7d5c194ed28dfa, State: Running, Role: LEADER
I20260808 15:01:13.003980 12216 consensus_queue.cc:237] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34445 } } peers { permanent_uuid: "996bc5e1cd8448589cb193598654a1d2" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 33409 } } peers { permanent_uuid: "892b578c14d043aba79c2415fe423ee3" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 40519 } }
I20260808 15:01:13.009053 11377 catalog_manager.cc:5495] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa reported cstate change: term changed from 0 to 1, leader changed from <none> to a56a67eac0be48bcad7d5c194ed28dfa (127.12.73.129). New cstate: current_term: 1 leader_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a56a67eac0be48bcad7d5c194ed28dfa" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "996bc5e1cd8448589cb193598654a1d2" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 33409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "892b578c14d043aba79c2415fe423ee3" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 40519 } health_report { overall_health: UNKNOWN } } }
I20260808 15:01:13.072217 12196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:13.066315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36224 (local address 127.12.73.129:34445)
0808 15:01:13.066502 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:13.066509 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:13.066609 (+ 100us) server_negotiation.cc:407] Connection header received
0808 15:01:13.066785 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:13.066791 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:13.066926 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:13.067076 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:01:13.067445 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:13.068513 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:13.069970 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:13.070379 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:13.070485 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:13.071102 (+ 617us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:01:13.071543 (+ 441us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:01:13.071667 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:13.071865 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 15:01:13.071927 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 15:01:13.081018 11845 raft_consensus.cc:1261] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3 [term 1 FOLLOWER]: Refusing update from remote peer a56a67eac0be48bcad7d5c194ed28dfa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:01:13.081220 12075 raft_consensus.cc:1261] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2 [term 1 FOLLOWER]: Refusing update from remote peer a56a67eac0be48bcad7d5c194ed28dfa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:01:13.082168 12223 consensus_queue.cc:1035] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "892b578c14d043aba79c2415fe423ee3" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 40519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:01:13.082659 12216 consensus_queue.cc:1035] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "996bc5e1cd8448589cb193598654a1d2" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 33409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:01:13.094640 12226 mvcc.cc:205] Tried to move back new op lower bound from 7316280414529536000 to 7316280414228066304. Current Snapshot: MvccSnapshot[applied={T|T < 7316280414529536000}]
I20260808 15:01:13.095054 12229 mvcc.cc:205] Tried to move back new op lower bound from 7316280414529536000 to 7316280414228066304. Current Snapshot: MvccSnapshot[applied={T|T < 7316280414529536000}]
I20260808 15:01:13.110232 11371 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:01:13.110512 11371 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:01:13.114040 11371 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a772b6af26f64d13bfbca0598bb375f1: Sending DeleteTablet for 3 replicas of tablet 495b9e41289142eb9174ddeb7d2e7dc3
I20260808 15:01:13.115182 11583 tablet_service.cc:1514] Processing DeleteTablet for tablet 495b9e41289142eb9174ddeb7d2e7dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:13 UTC) from {username='slave'} at 127.0.0.1:36214
I20260808 15:01:13.115386 12043 tablet_service.cc:1514] Processing DeleteTablet for tablet 495b9e41289142eb9174ddeb7d2e7dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:13 UTC) from {username='slave'} at 127.0.0.1:42218
I20260808 15:01:13.116171 12239 tablet_replica.cc:330] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa: stopping tablet replica
I20260808 15:01:13.116106 11804 tablet_service.cc:1514] Processing DeleteTablet for tablet 495b9e41289142eb9174ddeb7d2e7dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:13 UTC) from {username='slave'} at 127.0.0.1:36300
I20260808 15:01:13.116364 12240 tablet_replica.cc:330] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2: stopping tablet replica
I20260808 15:01:13.116683 12239 raft_consensus.cc:2229] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:01:13.116827 12240 raft_consensus.cc:2229] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:01:13.117528 12240 raft_consensus.cc:2258] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:13.117939 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 11480
I20260808 15:01:13.122920 12240 ts_tablet_manager.cc:1905] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:13.127247 12239 raft_consensus.cc:2258] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:13.127305 12241 tablet_replica.cc:330] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3: stopping tablet replica
I20260808 15:01:13.127674 12241 raft_consensus.cc:2229] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:01:13.128306 12241 raft_consensus.cc:2258] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:13.130560 12241 ts_tablet_manager.cc:1905] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:13.131839 12239 ts_tablet_manager.cc:1905] T 495b9e41289142eb9174ddeb7d2e7dc3 P a56a67eac0be48bcad7d5c194ed28dfa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:13.132023 12240 ts_tablet_manager.cc:1918] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:13.132246 12240 log.cc:1196] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/495b9e41289142eb9174ddeb7d2e7dc3
I20260808 15:01:13.132850 12240 ts_tablet_manager.cc:1939] T 495b9e41289142eb9174ddeb7d2e7dc3 P 996bc5e1cd8448589cb193598654a1d2: Deleting consensus metadata
I20260808 15:01:13.134680 11343 catalog_manager.cc:4841] TS 996bc5e1cd8448589cb193598654a1d2 (127.12.73.131:33409): tablet 495b9e41289142eb9174ddeb7d2e7dc3 (table test-table [id=2b0d6d86b76e4b388214cc2be7671679]) successfully deleted
I20260808 15:01:13.138674 12241 ts_tablet_manager.cc:1918] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:13.138849 12241 log.cc:1196] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/495b9e41289142eb9174ddeb7d2e7dc3
I20260808 15:01:13.139384 12241 ts_tablet_manager.cc:1939] T 495b9e41289142eb9174ddeb7d2e7dc3 P 892b578c14d043aba79c2415fe423ee3: Deleting consensus metadata
I20260808 15:01:13.140810 11343 catalog_manager.cc:4841] TS 892b578c14d043aba79c2415fe423ee3 (127.12.73.130:40519): tablet 495b9e41289142eb9174ddeb7d2e7dc3 (table test-table [id=2b0d6d86b76e4b388214cc2be7671679]) successfully deleted
I20260808 15:01:13.139101 12196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:13.120067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36238 (local address 127.12.73.129:34445)
0808 15:01:13.120301 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:13.120311 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:13.130622 (+ 10311us) server_negotiation.cc:407] Connection header received
0808 15:01:13.131103 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:13.131109 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:13.131220 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:13.131295 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:13.131969 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:13.133194 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:13.135219 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:13.135905 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:13.136040 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:13.137407 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:13.137418 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:13.137434 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:13.138187 (+ 753us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:13.138265 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:13.138292 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:13.138406 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:13.138581 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 15:01:13.138700 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 15:01:13.141901 11676 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:13.241122 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 11480
W20260808 15:01:13.266757 11343 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.73.129:34445 (error 108)
I20260808 15:01:13.267042 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 11696
I20260808 15:01:13.269024 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:13.268107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:34445 (local address 127.0.0.1:36248)
0808 15:01:13.268587 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:13.268780 (+ 193us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:34445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":231,"threads_started":1}
W20260808 15:01:13.269321 11343 catalog_manager.cc:4584] TS a56a67eac0be48bcad7d5c194ed28dfa (127.12.73.129:34445): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 495b9e41289142eb9174ddeb7d2e7dc3: Network error: Client connection negotiation failed: client connection to 127.12.73.129:34445: connect: Connection refused (error 111)
I20260808 15:01:13.274607 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:13.267945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36314 (local address 127.12.73.130:40519)
0808 15:01:13.268161 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:13.268166 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:13.268335 (+ 169us) server_negotiation.cc:407] Connection header received
0808 15:01:13.268556 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:13.268562 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:13.268674 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:13.268796 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:13.269206 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:13.270081 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:13.271364 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:13.271779 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:13.271920 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:13.273007 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:13.273016 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:13.273030 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:13.273780 (+ 750us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:13.273854 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:13.273875 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:13.274012 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:13.274173 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 15:01:13.274281 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 15:01:13.275229 11921 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:13.322966 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:13.322387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:34445 (local address 127.0.0.1:36258)
0808 15:01:13.322634 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:13.322780 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:34445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 15:01:13.324056 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:13.323666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:34445 (local address 127.0.0.1:36266)
0808 15:01:13.323797 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:13.323881 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:34445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 15:01:13.365852 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 11696
I20260808 15:01:13.384819 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:13.384292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:34445 (local address 127.0.0.1:36278)
0808 15:01:13.384562 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:13.384658 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:34445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260808 15:01:13.385936 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:13.385558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:34445 (local address 127.0.0.1:36286)
0808 15:01:13.385706 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:13.385789 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:34445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 15:01:13.390118 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 11932
I20260808 15:01:13.396550 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:13.390912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42224 (local address 127.12.73.131:33409)
0808 15:01:13.391088 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:13.391092 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:13.391109 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:01:13.391165 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:13.391168 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:13.391303 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:13.391399 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:13.391759 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:13.392569 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:13.393861 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:13.394288 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:13.394385 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:13.395359 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:13.395368 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:13.395384 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:13.395946 (+ 562us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:13.395995 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:13.396015 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:13.396101 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:13.396212 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 15:01:13.396295 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:01:13.397290 12165 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:13.466307 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:13.465803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:34445 (local address 127.0.0.1:36288)
0808 15:01:13.466043 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:13.466140 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:34445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 15:01:13.467453 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:13.467023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:34445 (local address 127.0.0.1:36292)
0808 15:01:13.467218 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:13.467305 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:34445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260808 15:01:13.485613 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 11932
I20260808 15:01:13.510092 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 11306
I20260808 15:01:13.511248 11427 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:13.620570 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 11306
2026-08-08T15:01:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3098 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:13 dist-test-slave-z8x9 krb5kdc[12253](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:13 dist-test-slave-z8x9 krb5kdc[12253](info): set up 2 sockets
Aug 08 15:01:13 dist-test-slave-z8x9 krb5kdc[12253](info): commencing operation
krb5kdc: starting...
W20260808 15:01:14.995972 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:15 dist-test-slave-z8x9 krb5kdc[12253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 15:01:15.314289 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33861
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:35355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:33861
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:15.655881 12279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:15.656167 12279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:15.656312 12279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:15.664258 12279 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:15.664381 12279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:15.664465 12279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:15.664568 12279 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:15.664656 12279 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:15.674484 12279 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:33861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:33861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:15.675872 12279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:15.677273 12279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:15.689618 12286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:15.689759 12287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:15.689728 12298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:15.690555 12279 server_base.cc:1034] running on GCE node
I20260808 15:01:15.691418 12279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:15.692840 12279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:15.694084 12279 hybrid_clock.cc:648] HybridClock initialized: now 1786201275694033 us; error 57 us; skew 500 ppm
I20260808 15:01:15.694458 12279 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:15 dist-test-slave-z8x9 krb5kdc[12253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201275, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:15.697710 12279 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:01:15.699398 12279 webserver.cc:460] Webserver started at http://127.12.73.190:38717/ using document root <none> and password file <none>
I20260808 15:01:15.700147 12279 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:15.700307 12279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:15.700625 12279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:15.703799 12279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "87e7796a3028460eb7ff43b99c553057"
format_stamp: "Formatted at 2026-08-08 15:01:15 on dist-test-slave-z8x9"
server_key: "ca14a386683997b86d692754b86d4ae1"
server_key_iv: "ea68b23a9a5fbbec9e3fda0b3998f470"
server_key_version: "encryptionkey@0"
I20260808 15:01:15.704581 12279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "87e7796a3028460eb7ff43b99c553057"
format_stamp: "Formatted at 2026-08-08 15:01:15 on dist-test-slave-z8x9"
server_key: "ca14a386683997b86d692754b86d4ae1"
server_key_iv: "ea68b23a9a5fbbec9e3fda0b3998f470"
server_key_version: "encryptionkey@0"
I20260808 15:01:15.709982 12279 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260808 15:01:15.713593 12311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:15.714934 12279 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 15:01:15.715130 12279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "87e7796a3028460eb7ff43b99c553057"
format_stamp: "Formatted at 2026-08-08 15:01:15 on dist-test-slave-z8x9"
server_key: "ca14a386683997b86d692754b86d4ae1"
server_key_iv: "ea68b23a9a5fbbec9e3fda0b3998f470"
server_key_version: "encryptionkey@0"
I20260808 15:01:15.715338 12279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:15.733984 12279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:15.738178 12279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:15.738485 12279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:15.757869 12279 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:33861
I20260808 15:01:15.757875 12408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:33861 every 8 connection(s)
I20260808 15:01:15.759299 12279 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:15.763023 12411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:15.764961 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 12279
I20260808 15:01:15.765221 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:15.765663 12582 external_mini_cluster.cc:1428] Setting key e03e89ac4213bd9247430d7e924760cb
I20260808 15:01:15.775516 12411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057: Bootstrap starting.
I20260808 15:01:15.779516 12411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:15.780758 12411 log.cc:824] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:01:15 dist-test-slave-z8x9 krb5kdc[12253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:15.783730 12411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057: No bootstrap required, opened a new log
I20260808 15:01:15.790673 12418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:15.767555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59596 (local address 127.12.73.190:33861)
0808 15:01:15.768429 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:15.768440 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:15.768481 (+ 41us) server_negotiation.cc:407] Connection header received
0808 15:01:15.770250 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:15.770273 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:15.770629 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:15.770924 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:15.772830 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:15.774234 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:15.776091 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:15.776759 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:15.776897 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:15.782026 (+ 5129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:15.782035 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:15.782049 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:15.782084 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:15.786024 (+ 3940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:15.786696 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:15.786708 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:15.786721 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:15.786935 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:15.787309 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:15.787315 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:15.787318 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:15.788070 (+ 752us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:15.788451 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:15.788767 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 15:01:15.789261 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":402,"threads_started":1}
I20260808 15:01:15.794530 12411 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87e7796a3028460eb7ff43b99c553057" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33861 } }
I20260808 15:01:15.794879 12411 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:15.794955 12411 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87e7796a3028460eb7ff43b99c553057, State: Initialized, Role: FOLLOWER
I20260808 15:01:15.795434 12411 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87e7796a3028460eb7ff43b99c553057" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33861 } }
I20260808 15:01:15.795637 12411 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:15.795746 12411 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:15.795882 12411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:15.798225 12411 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87e7796a3028460eb7ff43b99c553057" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33861 } }
I20260808 15:01:15.798741 12411 leader_election.cc:302] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87e7796a3028460eb7ff43b99c553057; no voters:
I20260808 15:01:15.799335 12411 leader_election.cc:288] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:15.799451 12421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:15.800631 12421 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [term 1 LEADER]: Becoming Leader. State: Replica: 87e7796a3028460eb7ff43b99c553057, State: Running, Role: LEADER
I20260808 15:01:15.801220 12421 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87e7796a3028460eb7ff43b99c553057" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33861 } }
I20260808 15:01:15.801559 12411 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:15.803936 12427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87e7796a3028460eb7ff43b99c553057. Latest consensus state: current_term: 1 leader_uuid: "87e7796a3028460eb7ff43b99c553057" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87e7796a3028460eb7ff43b99c553057" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33861 } } }
I20260808 15:01:15.804347 12427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:15.804873 12424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87e7796a3028460eb7ff43b99c553057" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87e7796a3028460eb7ff43b99c553057" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 33861 } } }
I20260808 15:01:15.805143 12424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:15.807008 12442 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:15.811970 12442 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:15.821393 12442 catalog_manager.cc:1347] Generated new cluster ID: 59fa067efb224801b8fa257f711b187f
I20260808 15:01:15.821573 12442 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:15.853222 12442 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:15.854856 12442 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:15.860922 12442 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057: Generated new TSK 0
I20260808 15:01:15.861807 12442 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.73.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
Entry for principal kudu/127.12.73.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab.
I20260808 15:01:15.956367 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33861
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:35355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:16.300590 12468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:16.300874 12468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:16.301003 12468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:16.308787 12468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:16.308918 12468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:16.309099 12468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 15:01:16.318830 12468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.129.keytab
--principal=kudu/127.12.73.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33861
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:16.320101 12468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:16.321456 12468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:16.334359 12475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:16.334453 12474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:16.334427 12478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:16.335377 12468 server_base.cc:1034] running on GCE node
I20260808 15:01:16.335999 12468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:16.336971 12468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:16.338266 12468 hybrid_clock.cc:648] HybridClock initialized: now 1786201276338207 us; error 34 us; skew 500 ppm
I20260808 15:01:16.338596 12468 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:16 dist-test-slave-z8x9 krb5kdc[12253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201276, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:16.341838 12468 init.cc:377] Logged in from keytab as kudu/127.12.73.129@KRBTEST.COM (short username kudu)
I20260808 15:01:16.343326 12468 webserver.cc:460] Webserver started at http://127.12.73.129:40927/ using document root <none> and password file <none>
I20260808 15:01:16.344022 12468 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:16.344183 12468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:16.344518 12468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:16.347575 12468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "237ce6977f794e6a8556e20bfd7a47c4"
format_stamp: "Formatted at 2026-08-08 15:01:16 on dist-test-slave-z8x9"
server_key: "0b5346be7af9a175c06cf710f78070ef"
server_key_iv: "62c983145e3d764326af2c4b3c896037"
server_key_version: "encryptionkey@0"
I20260808 15:01:16.348448 12468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "237ce6977f794e6a8556e20bfd7a47c4"
format_stamp: "Formatted at 2026-08-08 15:01:16 on dist-test-slave-z8x9"
server_key: "0b5346be7af9a175c06cf710f78070ef"
server_key_iv: "62c983145e3d764326af2c4b3c896037"
server_key_version: "encryptionkey@0"
I20260808 15:01:16.354251 12468 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260808 15:01:16.358119 12492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:16.359583 12468 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:01:16.359774 12468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "237ce6977f794e6a8556e20bfd7a47c4"
format_stamp: "Formatted at 2026-08-08 15:01:16 on dist-test-slave-z8x9"
server_key: "0b5346be7af9a175c06cf710f78070ef"
server_key_iv: "62c983145e3d764326af2c4b3c896037"
server_key_version: "encryptionkey@0"
I20260808 15:01:16.360000 12468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:16.374904 12468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:16.378813 12468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:16.379122 12468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:16.380018 12468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:16.381337 12468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:16.381413 12468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:16.381496 12468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:16.381544 12468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:16.415740 12468 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:42843
I20260808 15:01:16.415782 12719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:42843 every 8 connection(s)
I20260808 15:01:16.417075 12468 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 15:01:16.419885 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 12468
I20260808 15:01:16.420091 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 15:01:16.420554 12582 external_mini_cluster.cc:1428] Setting key 21796c9450d38b5fea46dd3addaa5ac5
Aug 08 15:01:16 dist-test-slave-z8x9 krb5kdc[12253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201276, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.129@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:16.439494 12722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:16.419672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:47623 (local address 127.12.73.190:33861)
0808 15:01:16.420221 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:16.420229 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:16.421290 (+ 1061us) server_negotiation.cc:407] Connection header received
0808 15:01:16.423529 (+ 2239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:16.423537 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:16.423627 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:16.423749 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:16.425346 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:16.426517 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:16.428023 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:16.428734 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:16.428883 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:16.432342 (+ 3459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:16.432352 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:16.432359 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:16.432407 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:16.436146 (+ 3739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:16.436903 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:16.436912 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:16.436923 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:16.437085 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:16.437687 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:16.437692 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:16.437695 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:16.437973 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:16.438089 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:16.439032 (+ 943us) server_negotiation.cc:299] Negotiation successful
0808 15:01:16.439226 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":246,"threads_started":1}
I20260808 15:01:16.441010 12724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:16.420267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33861 (local address 127.12.73.129:47623)
0808 15:01:16.421093 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:16.421149 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:16.423233 (+ 2084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:16.423946 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:16.423955 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:16.424567 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:16.425125 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:16.425142 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:16.426672 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:16.426675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:16.427877 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:16.427888 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:16.428946 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:16.428950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:16.429149 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:16.429936 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:01:16.429957 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:16.432106 (+ 2149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:16.436304 (+ 4198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:16.436311 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:16.436324 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:16.436761 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:16.437264 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:16.437271 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:16.437277 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:16.437571 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:16.438107 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:16.438118 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:16.438619 (+ 501us) client_negotiation.cc:769] Sending connection context
0808 15:01:16.438929 (+ 310us) client_negotiation.cc:240] Negotiation successful
0808 15:01:16.439536 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":345,"threads_started":1}
I20260808 15:01:16.443055 12720 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33861
I20260808 15:01:16.443382 12720 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:16.444131 12720 heartbeater.cc:511] Master 127.12.73.190:33861 requested a full tablet report, sending...
I20260808 15:01:16.446288 12336 ts_manager.cc:194] Registered new tserver with Master: 237ce6977f794e6a8556e20bfd7a47c4 (127.12.73.129:42843)
I20260808 15:01:16.447733 12336 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.129@KRBTEST.COM'} at 127.12.73.129:47623
WARNING: no policy specified for kudu/127.12.73.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
Entry for principal kudu/127.12.73.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab.
I20260808 15:01:16.494678 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33861
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:35355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:16.835644 12728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:16.835983 12728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:16.836162 12728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:16.843902 12728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:16.844038 12728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:16.844223 12728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 15:01:16.853749 12728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.130.keytab
--principal=kudu/127.12.73.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33861
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:16.855068 12728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:16.856410 12728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:16.869737 12737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:16.869654 12740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:16.869679 12738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:16.870854 12728 server_base.cc:1034] running on GCE node
I20260808 15:01:16.871479 12728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:16.872531 12728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:16.873785 12728 hybrid_clock.cc:648] HybridClock initialized: now 1786201276873738 us; error 60 us; skew 500 ppm
I20260808 15:01:16.874182 12728 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:16 dist-test-slave-z8x9 krb5kdc[12253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201276, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:16.877554 12728 init.cc:377] Logged in from keytab as kudu/127.12.73.130@KRBTEST.COM (short username kudu)
I20260808 15:01:16.879076 12728 webserver.cc:460] Webserver started at http://127.12.73.130:33189/ using document root <none> and password file <none>
I20260808 15:01:16.879765 12728 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:16.879912 12728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:16.880237 12728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:16.883133 12728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "a48e8243a7454f34bde1d4dc4a2c90a2"
format_stamp: "Formatted at 2026-08-08 15:01:16 on dist-test-slave-z8x9"
server_key: "562812eeac57704bfccaf136afd2866c"
server_key_iv: "7213f8847bc499c8a70e8d24d3ab0b1a"
server_key_version: "encryptionkey@0"
I20260808 15:01:16.883913 12728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "a48e8243a7454f34bde1d4dc4a2c90a2"
format_stamp: "Formatted at 2026-08-08 15:01:16 on dist-test-slave-z8x9"
server_key: "562812eeac57704bfccaf136afd2866c"
server_key_iv: "7213f8847bc499c8a70e8d24d3ab0b1a"
server_key_version: "encryptionkey@0"
I20260808 15:01:16.889285 12728 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 15:01:16.892575 12750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:16.893908 12728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 15:01:16.894100 12728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "a48e8243a7454f34bde1d4dc4a2c90a2"
format_stamp: "Formatted at 2026-08-08 15:01:16 on dist-test-slave-z8x9"
server_key: "562812eeac57704bfccaf136afd2866c"
server_key_iv: "7213f8847bc499c8a70e8d24d3ab0b1a"
server_key_version: "encryptionkey@0"
I20260808 15:01:16.894299 12728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:16.914497 12728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:16.919050 12728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:16.919337 12728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:16.920423 12728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:16.921826 12728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:16.921932 12728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:16.922094 12728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:16.922173 12728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:16.957532 12728 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:42425
I20260808 15:01:16.957592 12961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:42425 every 8 connection(s)
I20260808 15:01:16.958823 12728 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 15:01:16.965946 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 12728
I20260808 15:01:16.966157 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 15:01:16.966746 12582 external_mini_cluster.cc:1428] Setting key 7c0238c4867d5a61d6e0db1c85f8ac46
Aug 08 15:01:16 dist-test-slave-z8x9 krb5kdc[12253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201276, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.130@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:16.983165 12967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:16.961436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:39439 (local address 127.12.73.190:33861)
0808 15:01:16.961928 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:16.961933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:16.962801 (+ 868us) server_negotiation.cc:407] Connection header received
0808 15:01:16.964951 (+ 2150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:16.964958 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:16.965055 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:16.965184 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:16.967343 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:16.968202 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:16.970486 (+ 2284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:16.970920 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:16.971023 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:16.975633 (+ 4610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:16.975642 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:16.975650 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:16.975692 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:16.979420 (+ 3728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:16.980295 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:16.980304 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:16.980310 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:16.980472 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:16.980938 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:16.980946 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:16.980951 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:16.981442 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:16.981616 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:16.982393 (+ 777us) server_negotiation.cc:299] Negotiation successful
0808 15:01:16.982647 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":275,"threads_started":1}
I20260808 15:01:16.984016 12969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:16.961842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33861 (local address 127.12.73.130:39439)
0808 15:01:16.962579 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:16.962618 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:16.964627 (+ 2009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:16.965456 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:16.965464 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:16.966313 (+ 849us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:16.967110 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:16.967153 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:16.968364 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:16.968369 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:16.970324 (+ 1955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:16.970343 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:16.971193 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:16.971203 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:16.971535 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:16.972292 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:01:16.972334 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:16.975371 (+ 3037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:16.979571 (+ 4200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:16.979581 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:16.979597 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:16.980154 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:16.980586 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:16.980592 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:16.980598 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:16.980814 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:16.981574 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:16.981583 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:16.981975 (+ 392us) client_negotiation.cc:769] Sending connection context
0808 15:01:16.982239 (+ 264us) client_negotiation.cc:240] Negotiation successful
0808 15:01:16.982742 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":301,"threads_started":1}
I20260808 15:01:16.985505 12964 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33861
I20260808 15:01:16.985836 12964 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:16.986696 12964 heartbeater.cc:511] Master 127.12.73.190:33861 requested a full tablet report, sending...
I20260808 15:01:16.988201 12336 ts_manager.cc:194] Registered new tserver with Master: a48e8243a7454f34bde1d4dc4a2c90a2 (127.12.73.130:42425)
I20260808 15:01:16.989009 12336 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.130@KRBTEST.COM'} at 127.12.73.130:39439
WARNING: no policy specified for kudu/127.12.73.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
Entry for principal kudu/127.12.73.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab.
I20260808 15:01:17.044286 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33861
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:35355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:17.380692 12975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:17.380975 12975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:17.381079 12975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:17.388515 12975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:17.388628 12975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:17.388738 12975 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 15:01:17.398465 12975 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.131.keytab
--principal=kudu/127.12.73.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:33861
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:17.399760 12975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:17.401049 12975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:17.414638 12983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:17.414665 12990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:17.414598 12993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:17.415933 12975 server_base.cc:1034] running on GCE node
I20260808 15:01:17.416713 12975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:17.417886 12975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:17.419116 12975 hybrid_clock.cc:648] HybridClock initialized: now 1786201277419056 us; error 58 us; skew 500 ppm
I20260808 15:01:17.419466 12975 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:17 dist-test-slave-z8x9 krb5kdc[12253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201277, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:17.423137 12975 init.cc:377] Logged in from keytab as kudu/127.12.73.131@KRBTEST.COM (short username kudu)
I20260808 15:01:17.424705 12975 webserver.cc:460] Webserver started at http://127.12.73.131:38733/ using document root <none> and password file <none>
I20260808 15:01:17.425460 12975 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:17.425607 12975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:17.425928 12975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:17.428803 12975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "a586417109d8416fa04aa16f49a54a18"
format_stamp: "Formatted at 2026-08-08 15:01:17 on dist-test-slave-z8x9"
server_key: "554005c59d79be570018991ab2c32666"
server_key_iv: "ac68304103ede03fb2239d3e2f4d3161"
server_key_version: "encryptionkey@0"
I20260808 15:01:17.429600 12975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "a586417109d8416fa04aa16f49a54a18"
format_stamp: "Formatted at 2026-08-08 15:01:17 on dist-test-slave-z8x9"
server_key: "554005c59d79be570018991ab2c32666"
server_key_iv: "ac68304103ede03fb2239d3e2f4d3161"
server_key_version: "encryptionkey@0"
I20260808 15:01:17.434762 12975 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 15:01:17.438268 13006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:17.439567 12975 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:01:17.439740 12975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "a586417109d8416fa04aa16f49a54a18"
format_stamp: "Formatted at 2026-08-08 15:01:17 on dist-test-slave-z8x9"
server_key: "554005c59d79be570018991ab2c32666"
server_key_iv: "ac68304103ede03fb2239d3e2f4d3161"
server_key_version: "encryptionkey@0"
I20260808 15:01:17.439947 12975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:17.450729 12720 heartbeater.cc:503] Master 127.12.73.190:33861 was elected leader, sending a full tablet report...
I20260808 15:01:17.460948 12975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:17.465140 12975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:17.465476 12975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:17.466430 12975 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:17.467724 12975 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:17.467832 12975 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:17.467978 12975 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:17.468051 12975 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:17.502120 12975 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:39441
I20260808 15:01:17.502229 13214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:39441 every 8 connection(s)
I20260808 15:01:17.503507 12975 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 15:01:17.505766 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 12975
I20260808 15:01:17.505981 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 15:01:17.506578 12582 external_mini_cluster.cc:1428] Setting key 7f6a2fefb753947d2a32b33098e90c4c
Aug 08 15:01:17 dist-test-slave-z8x9 krb5kdc[12253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201277, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.131@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:17.524468 13217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:17.506262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:60069 (local address 127.12.73.190:33861)
0808 15:01:17.506792 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:17.506796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:17.510005 (+ 3209us) server_negotiation.cc:407] Connection header received
0808 15:01:17.510056 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:17.510060 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:17.510121 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:17.510200 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:17.511709 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.512446 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.513988 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.514390 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.514481 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:17.517972 (+ 3491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:17.517977 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:17.517981 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:17.518033 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:17.521668 (+ 3635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:17.522397 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:17.522401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:17.522403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:17.522523 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:17.522928 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:17.522933 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:17.522935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:17.523243 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:17.523364 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:17.523984 (+ 620us) server_negotiation.cc:299] Negotiation successful
0808 15:01:17.524185 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":268,"threads_started":1}
I20260808 15:01:17.525362 13218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:17.506891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:33861 (local address 127.12.73.131:60069)
0808 15:01:17.507780 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:17.507831 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:17.509719 (+ 1888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:17.510433 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:17.510441 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:17.510986 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:17.511550 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:17.511567 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.512571 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.512575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:17.513852 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:17.513865 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.514585 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.514590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:17.514776 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:17.515506 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:01:17.515533 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:17.517752 (+ 2219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:17.521827 (+ 4075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:17.521836 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:17.521850 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:17.522274 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:17.522612 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:01:17.522615 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:01:17.522617 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:01:17.522792 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:01:17.523358 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:17.523364 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:17.523650 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 15:01:17.523864 (+ 214us) client_negotiation.cc:240] Negotiation successful
0808 15:01:17.524220 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":369,"threads_started":1}
I20260808 15:01:17.526736 13215 heartbeater.cc:347] Connected to a master server at 127.12.73.190:33861
I20260808 15:01:17.527038 13215 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:17.527745 13215 heartbeater.cc:511] Master 127.12.73.190:33861 requested a full tablet report, sending...
I20260808 15:01:17.529209 12336 ts_manager.cc:194] Registered new tserver with Master: a586417109d8416fa04aa16f49a54a18 (127.12.73.131:39441)
I20260808 15:01:17.530030 12336 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.73.131@KRBTEST.COM'} at 127.12.73.131:60069
I20260808 15:01:17.534057 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:01:17.551350 13217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:17.538220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59604 (local address 127.12.73.190:33861)
0808 15:01:17.538386 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:17.538392 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:17.538890 (+ 498us) server_negotiation.cc:407] Connection header received
0808 15:01:17.539106 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:17.539111 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:17.539218 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:17.539328 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:17.540742 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.541551 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.542871 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.543295 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.543431 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:17.546003 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:17.546008 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:17.546011 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:17.546042 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:17.548505 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:17.549285 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:17.549294 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:17.549298 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:17.549428 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:17.549832 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:17.549837 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:17.549841 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:17.550190 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:17.550446 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:17.550799 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 15:01:17.551028 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 15:01:17.555014 12336 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59604:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:01:17.562214 12336 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:01:17.589697 13241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:17.575109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44294 (local address 127.12.73.129:42843)
0808 15:01:17.575755 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:17.575764 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:17.575792 (+ 28us) server_negotiation.cc:407] Connection header received
0808 15:01:17.575911 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:17.575922 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:17.576234 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:17.576449 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:17.578791 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.580808 (+ 2017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.586722 (+ 5914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.588220 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.588366 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:17.588628 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:17.589154 (+ 526us) server_negotiation.cc:299] Negotiation successful
0808 15:01:17.589364 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":1581,"threads_started":1}
I20260808 15:01:17.589711 13235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:17.574426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:42843 (local address 127.0.0.1:44294)
0808 15:01:17.575350 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:17.575390 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:17.575557 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:17.576792 (+ 1235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:17.576799 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:17.576835 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:17.578541 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:17.578561 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.582148 (+ 3587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.582157 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:17.586542 (+ 4385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:17.586556 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.588769 (+ 2213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.588776 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:17.588937 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:17.588974 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 15:01:17.589110 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 15:01:17.589324 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":569,"threads_started":1}
I20260808 15:01:17.594516 13238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:17.574643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:39441 (local address 127.0.0.1:39444)
0808 15:01:17.585386 (+ 10743us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:17.585412 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:17.585552 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:17.587016 (+ 1464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:17.587021 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:17.587051 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:17.587580 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:17.587594 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.589707 (+ 2113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.589715 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:17.591863 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:17.591878 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.593669 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.593676 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:17.593848 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:17.593883 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 15:01:17.593996 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 15:01:17.594135 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10574,"thread_start_us":11013,"threads_started":1}
I20260808 15:01:17.594571 13248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:17.575879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39444 (local address 127.12.73.131:39441)
0808 15:01:17.586386 (+ 10507us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:17.586395 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:17.586431 (+ 36us) server_negotiation.cc:407] Connection header received
0808 15:01:17.586526 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:17.586534 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:17.586800 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:17.587681 (+ 881us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:17.587989 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.589518 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.592045 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.593453 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.593590 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:17.593807 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:17.594053 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 15:01:17.594231 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10332,"thread_start_us":10162,"threads_started":1}
I20260808 15:01:17.593924 12593 tablet_service.cc:1467] Processing CreateTablet for tablet 089af3d9540d4921a11f51d1a49584f3 (DEFAULT_TABLE table=test-table [id=c60799f612954ddfade36ef14f414f6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:17.595602 12593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 089af3d9540d4921a11f51d1a49584f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:17.595698 13243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:17.575779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:42425 (local address 127.0.0.1:50792)
0808 15:01:17.587376 (+ 11597us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:17.587401 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:17.587547 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:17.588224 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:17.588229 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:17.588256 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:17.588626 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:17.588639 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.591305 (+ 2666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.591312 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:17.592869 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:17.592882 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.594919 (+ 2037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.594927 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:17.595093 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:17.595142 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 15:01:17.595247 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 15:01:17.595377 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11464,"thread_start_us":11240,"threads_started":1}
I20260808 15:01:17.595841 13249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:17.576290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50792 (local address 127.12.73.130:42425)
0808 15:01:17.586808 (+ 10518us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:17.586820 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:17.587551 (+ 731us) server_negotiation.cc:407] Connection header received
0808 15:01:17.587764 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:17.587772 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:17.587989 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:17.588230 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:17.588817 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.590604 (+ 1787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.593036 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:17.594405 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:17.594553 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:17.594789 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:17.595320 (+ 531us) server_negotiation.cc:299] Negotiation successful
0808 15:01:17.595500 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10368,"thread_start_us":10251,"threads_started":1}
I20260808 15:01:17.599097 12844 tablet_service.cc:1467] Processing CreateTablet for tablet 089af3d9540d4921a11f51d1a49584f3 (DEFAULT_TABLE table=test-table [id=c60799f612954ddfade36ef14f414f6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:17.598968 13087 tablet_service.cc:1467] Processing CreateTablet for tablet 089af3d9540d4921a11f51d1a49584f3 (DEFAULT_TABLE table=test-table [id=c60799f612954ddfade36ef14f414f6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:17.600253 12844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 089af3d9540d4921a11f51d1a49584f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:17.600405 13087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 089af3d9540d4921a11f51d1a49584f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:17.610921 13250 tablet_bootstrap.cc:492] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4: Bootstrap starting.
I20260808 15:01:17.615757 13250 tablet_bootstrap.cc:654] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:17.616891 13253 tablet_bootstrap.cc:492] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2: Bootstrap starting.
I20260808 15:01:17.617228 13250 log.cc:824] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:17.618844 13259 tablet_bootstrap.cc:492] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18: Bootstrap starting.
I20260808 15:01:17.620782 13253 tablet_bootstrap.cc:654] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:17.621629 13259 tablet_bootstrap.cc:654] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:17.621876 13253 log.cc:824] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:17.622860 13259 log.cc:824] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:17.623759 13250 tablet_bootstrap.cc:492] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4: No bootstrap required, opened a new log
I20260808 15:01:17.624140 13250 ts_tablet_manager.cc:1397] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260808 15:01:17.625239 13253 tablet_bootstrap.cc:492] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2: No bootstrap required, opened a new log
I20260808 15:01:17.625509 13253 ts_tablet_manager.cc:1397] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20260808 15:01:17.626205 13259 tablet_bootstrap.cc:492] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18: No bootstrap required, opened a new log
I20260808 15:01:17.626456 13259 ts_tablet_manager.cc:1397] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20260808 15:01:17.632283 13253 raft_consensus.cc:348] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237ce6977f794e6a8556e20bfd7a47c4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42843 } } peers { permanent_uuid: "a586417109d8416fa04aa16f49a54a18" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39441 } } peers { permanent_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42425 } }
I20260808 15:01:17.632642 13253 raft_consensus.cc:374] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:17.632745 13253 raft_consensus.cc:729] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a48e8243a7454f34bde1d4dc4a2c90a2, State: Initialized, Role: FOLLOWER
I20260808 15:01:17.633414 13253 consensus_queue.cc:260] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237ce6977f794e6a8556e20bfd7a47c4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42843 } } peers { permanent_uuid: "a586417109d8416fa04aa16f49a54a18" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39441 } } peers { permanent_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42425 } }
I20260808 15:01:17.634533 12964 heartbeater.cc:503] Master 127.12.73.190:33861 was elected leader, sending a full tablet report...
I20260808 15:01:17.635099 13253 ts_tablet_manager.cc:1428] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2: Time spent starting tablet: real 0.009s user 0.007s sys 0.002s
I20260808 15:01:17.636195 13250 raft_consensus.cc:348] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237ce6977f794e6a8556e20bfd7a47c4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42843 } } peers { permanent_uuid: "a586417109d8416fa04aa16f49a54a18" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39441 } } peers { permanent_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42425 } }
I20260808 15:01:17.636723 13250 raft_consensus.cc:374] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:17.636878 13250 raft_consensus.cc:729] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 237ce6977f794e6a8556e20bfd7a47c4, State: Initialized, Role: FOLLOWER
I20260808 15:01:17.636934 13259 raft_consensus.cc:348] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237ce6977f794e6a8556e20bfd7a47c4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42843 } } peers { permanent_uuid: "a586417109d8416fa04aa16f49a54a18" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39441 } } peers { permanent_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42425 } }
I20260808 15:01:17.637422 13259 raft_consensus.cc:374] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:17.637540 13259 raft_consensus.cc:729] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a586417109d8416fa04aa16f49a54a18, State: Initialized, Role: FOLLOWER
I20260808 15:01:17.638091 13250 consensus_queue.cc:260] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237ce6977f794e6a8556e20bfd7a47c4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42843 } } peers { permanent_uuid: "a586417109d8416fa04aa16f49a54a18" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39441 } } peers { permanent_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42425 } }
I20260808 15:01:17.638227 13259 consensus_queue.cc:260] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237ce6977f794e6a8556e20bfd7a47c4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42843 } } peers { permanent_uuid: "a586417109d8416fa04aa16f49a54a18" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39441 } } peers { permanent_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42425 } }
I20260808 15:01:17.639714 13250 ts_tablet_manager.cc:1428] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4: Time spent starting tablet: real 0.015s user 0.008s sys 0.005s
I20260808 15:01:17.642153 13259 ts_tablet_manager.cc:1428] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18: Time spent starting tablet: real 0.016s user 0.006s sys 0.010s
I20260808 15:01:17.642445 13215 heartbeater.cc:503] Master 127.12.73.190:33861 was elected leader, sending a full tablet report...
W20260808 15:01:17.669471 12721 tablet.cc:2369] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:01:17.711036 12965 tablet.cc:2369] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:01:17.755328 13216 tablet.cc:2369] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:01:18.026680 13273 raft_consensus.cc:482] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:01:18.027029 13273 raft_consensus.cc:504] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237ce6977f794e6a8556e20bfd7a47c4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42843 } } peers { permanent_uuid: "a586417109d8416fa04aa16f49a54a18" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39441 } } peers { permanent_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42425 } }
I20260808 15:01:18.028785 13273 leader_election.cc:288] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 237ce6977f794e6a8556e20bfd7a47c4 (127.12.73.129:42843), a48e8243a7454f34bde1d4dc4a2c90a2 (127.12.73.130:42425)
I20260808 15:01:18.035574 13241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:18.029119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:42337 (local address 127.12.73.129:42843)
0808 15:01:18.029383 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:18.029389 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:18.029812 (+ 423us) server_negotiation.cc:407] Connection header received
0808 15:01:18.030059 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:18.030064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:18.030145 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:18.030293 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:18.030946 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.031808 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.033769 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.034566 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.034689 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:18.034774 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:18.035162 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 15:01:18.035306 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 15:01:18.035712 13249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:18.029451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:55357 (local address 127.12.73.130:42425)
0808 15:01:18.029658 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:18.029663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:18.030305 (+ 642us) server_negotiation.cc:407] Connection header received
0808 15:01:18.030488 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:18.030494 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:18.030569 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:18.030669 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:18.031267 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.032060 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.033867 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.034673 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.034820 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:18.034905 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:18.035314 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 15:01:18.035445 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 15:01:18.035851 13275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:18.029468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:42425 (local address 127.12.73.131:55357)
0808 15:01:18.030195 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:18.030214 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:18.030333 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:18.030698 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:18.030701 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:18.030720 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:18.031099 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:18.031111 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.032209 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.032215 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:18.033704 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:18.033721 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.034899 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.034904 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:18.035048 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:18.035071 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 15:01:18.035234 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 15:01:18.035360 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"mutex_wait_us":2,"thread_start_us":377,"threads_started":1}
I20260808 15:01:18.035882 13274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:18.029000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:42843 (local address 127.12.73.131:42337)
0808 15:01:18.029682 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:18.029703 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:18.029883 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:18.030344 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:18.030349 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:18.030395 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:18.030770 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:18.030784 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.031936 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.031942 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:18.033604 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:18.033616 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.034721 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.034729 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:18.034913 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:18.035021 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 15:01:18.035098 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 15:01:18.035402 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":61,"thread_start_us":369,"threads_started":1}
I20260808 15:01:18.036924 12641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089af3d9540d4921a11f51d1a49584f3" candidate_uuid: "a586417109d8416fa04aa16f49a54a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "237ce6977f794e6a8556e20bfd7a47c4" is_pre_election: true
I20260808 15:01:18.037029 12880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089af3d9540d4921a11f51d1a49584f3" candidate_uuid: "a586417109d8416fa04aa16f49a54a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2" is_pre_election: true
I20260808 15:01:18.037500 12641 raft_consensus.cc:2454] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a586417109d8416fa04aa16f49a54a18 in term 0.
I20260808 15:01:18.037602 12880 raft_consensus.cc:2454] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a586417109d8416fa04aa16f49a54a18 in term 0.
I20260808 15:01:18.038261 13008 leader_election.cc:302] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 237ce6977f794e6a8556e20bfd7a47c4, a48e8243a7454f34bde1d4dc4a2c90a2, a586417109d8416fa04aa16f49a54a18; no voters:
I20260808 15:01:18.038676 13273 raft_consensus.cc:2781] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:01:18.038805 13273 raft_consensus.cc:482] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:01:18.038882 13273 raft_consensus.cc:3037] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:18.041014 13273 raft_consensus.cc:504] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237ce6977f794e6a8556e20bfd7a47c4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42843 } } peers { permanent_uuid: "a586417109d8416fa04aa16f49a54a18" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39441 } } peers { permanent_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42425 } }
I20260808 15:01:18.041659 13273 leader_election.cc:288] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [CANDIDATE]: Term 1 election: Requested vote from peers 237ce6977f794e6a8556e20bfd7a47c4 (127.12.73.129:42843), a48e8243a7454f34bde1d4dc4a2c90a2 (127.12.73.130:42425)
I20260808 15:01:18.042055 12641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089af3d9540d4921a11f51d1a49584f3" candidate_uuid: "a586417109d8416fa04aa16f49a54a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "237ce6977f794e6a8556e20bfd7a47c4"
I20260808 15:01:18.042140 12880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089af3d9540d4921a11f51d1a49584f3" candidate_uuid: "a586417109d8416fa04aa16f49a54a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2"
I20260808 15:01:18.042279 12641 raft_consensus.cc:3037] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:18.042332 12880 raft_consensus.cc:3037] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:18.045588 12880 raft_consensus.cc:2454] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a586417109d8416fa04aa16f49a54a18 in term 1.
I20260808 15:01:18.045588 12641 raft_consensus.cc:2454] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a586417109d8416fa04aa16f49a54a18 in term 1.
I20260808 15:01:18.045991 13008 leader_election.cc:302] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 237ce6977f794e6a8556e20bfd7a47c4, a586417109d8416fa04aa16f49a54a18; no voters:
I20260808 15:01:18.046289 13273 raft_consensus.cc:2781] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:18.046763 13273 raft_consensus.cc:686] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 1 LEADER]: Becoming Leader. State: Replica: a586417109d8416fa04aa16f49a54a18, State: Running, Role: LEADER
I20260808 15:01:18.047315 13273 consensus_queue.cc:237] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237ce6977f794e6a8556e20bfd7a47c4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42843 } } peers { permanent_uuid: "a586417109d8416fa04aa16f49a54a18" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39441 } } peers { permanent_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42425 } }
I20260808 15:01:18.052199 12335 catalog_manager.cc:5495] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to a586417109d8416fa04aa16f49a54a18 (127.12.73.131). New cstate: current_term: 1 leader_uuid: "a586417109d8416fa04aa16f49a54a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237ce6977f794e6a8556e20bfd7a47c4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a586417109d8416fa04aa16f49a54a18" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42425 } health_report { overall_health: UNKNOWN } } }
I20260808 15:01:18.149688 13283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:18.144155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39448 (local address 127.12.73.131:39441)
0808 15:01:18.144822 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:18.144827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:18.144851 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:01:18.144939 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:18.144942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:18.145025 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:18.145160 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:01:18.145622 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.146295 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.147611 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.147995 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.148082 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:18.148506 (+ 424us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:01:18.149013 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:01:18.149121 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:18.149305 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 15:01:18.149373 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":453,"threads_started":1}
I20260808 15:01:18.157594 12880 raft_consensus.cc:1261] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2 [term 1 FOLLOWER]: Refusing update from remote peer a586417109d8416fa04aa16f49a54a18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:01:18.157594 12641 raft_consensus.cc:1261] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4 [term 1 FOLLOWER]: Refusing update from remote peer a586417109d8416fa04aa16f49a54a18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:01:18.158617 13276 consensus_queue.cc:1035] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "237ce6977f794e6a8556e20bfd7a47c4" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 42843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:01:18.158977 13273 consensus_queue.cc:1035] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a48e8243a7454f34bde1d4dc4a2c90a2" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 42425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:01:18.173241 13286 mvcc.cc:205] Tried to move back new op lower bound from 7316280435322601472 to 7316280434885926912. Current Snapshot: MvccSnapshot[applied={T|T < 7316280435322601472}]
I20260808 15:01:18.177295 13290 mvcc.cc:205] Tried to move back new op lower bound from 7316280435322601472 to 7316280434885926912. Current Snapshot: MvccSnapshot[applied={T|T < 7316280435322601472}]
I20260808 15:01:18.191416 12335 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:01:18.191715 12335 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:01:18.195112 12335 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 87e7796a3028460eb7ff43b99c553057: Sending DeleteTablet for 3 replicas of tablet 089af3d9540d4921a11f51d1a49584f3
I20260808 15:01:18.196285 12593 tablet_service.cc:1514] Processing DeleteTablet for tablet 089af3d9540d4921a11f51d1a49584f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:18 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:44294
I20260808 15:01:18.196307 13087 tablet_service.cc:1514] Processing DeleteTablet for tablet 089af3d9540d4921a11f51d1a49584f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:18 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:39444
I20260808 15:01:18.196748 12844 tablet_service.cc:1514] Processing DeleteTablet for tablet 089af3d9540d4921a11f51d1a49584f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:18 UTC) from {username='kudu', principal='kudu/127.12.73.190@KRBTEST.COM'} at 127.0.0.1:50792
I20260808 15:01:18.198199 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 12468
I20260808 15:01:18.198261 13310 tablet_replica.cc:330] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2: stopping tablet replica
I20260808 15:01:18.198721 13310 raft_consensus.cc:2229] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:01:18.199247 13310 raft_consensus.cc:2258] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:18.200294 13309 tablet_replica.cc:330] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4: stopping tablet replica
I20260808 15:01:18.200667 13309 raft_consensus.cc:2229] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:01:18.201102 13309 raft_consensus.cc:2258] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:18.201452 13308 tablet_replica.cc:330] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18: stopping tablet replica
I20260808 15:01:18.201917 13308 raft_consensus.cc:2229] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:01:18.202600 13308 raft_consensus.cc:2258] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:18.203828 13309 ts_tablet_manager.cc:1905] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:18.206619 13310 ts_tablet_manager.cc:1905] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:18.211015 13308 ts_tablet_manager.cc:1905] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:18.214438 13310 ts_tablet_manager.cc:1918] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:18.214701 13310 log.cc:1196] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/089af3d9540d4921a11f51d1a49584f3
I20260808 15:01:18.215370 13310 ts_tablet_manager.cc:1939] T 089af3d9540d4921a11f51d1a49584f3 P a48e8243a7454f34bde1d4dc4a2c90a2: Deleting consensus metadata
I20260808 15:01:18.217433 12314 catalog_manager.cc:4841] TS a48e8243a7454f34bde1d4dc4a2c90a2 (127.12.73.130:42425): tablet 089af3d9540d4921a11f51d1a49584f3 (table test-table [id=c60799f612954ddfade36ef14f414f6a]) successfully deleted
I20260808 15:01:18.219290 13309 ts_tablet_manager.cc:1918] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:18.219488 13309 log.cc:1196] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/089af3d9540d4921a11f51d1a49584f3
I20260808 15:01:18.220990 13308 ts_tablet_manager.cc:1918] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:18.221259 13308 log.cc:1196] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/089af3d9540d4921a11f51d1a49584f3
I20260808 15:01:18.221863 13308 ts_tablet_manager.cc:1939] T 089af3d9540d4921a11f51d1a49584f3 P a586417109d8416fa04aa16f49a54a18: Deleting consensus metadata
I20260808 15:01:18.223568 13309 ts_tablet_manager.cc:1939] T 089af3d9540d4921a11f51d1a49584f3 P 237ce6977f794e6a8556e20bfd7a47c4: Deleting consensus metadata
I20260808 15:01:18.223783 12315 catalog_manager.cc:4841] TS a586417109d8416fa04aa16f49a54a18 (127.12.73.131:39441): tablet 089af3d9540d4921a11f51d1a49584f3 (table test-table [id=c60799f612954ddfade36ef14f414f6a]) successfully deleted
I20260808 15:01:18.225656 12312 catalog_manager.cc:4841] TS 237ce6977f794e6a8556e20bfd7a47c4 (127.12.73.129:42843): tablet 089af3d9540d4921a11f51d1a49584f3 (table test-table [id=c60799f612954ddfade36ef14f414f6a]) successfully deleted
Aug 08 15:01:18 dist-test-slave-z8x9 krb5kdc[12253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.129@KRBTEST.COM
I20260808 15:01:18.237526 13241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:18.199326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44308 (local address 127.12.73.129:42843)
0808 15:01:18.199519 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:18.199527 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:18.217766 (+ 18239us) server_negotiation.cc:407] Connection header received
0808 15:01:18.217982 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:18.217988 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:18.218080 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:18.218212 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:18.220270 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.221492 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.223437 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.224143 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.224292 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:18.230222 (+ 5930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:18.230242 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:18.230263 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:18.230313 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:18.234234 (+ 3921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:18.234954 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:18.234964 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:18.234968 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:18.235144 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:18.235687 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:18.235693 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:18.235696 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:18.236180 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:18.236496 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:18.236824 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 15:01:18.237066 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:01:18.238291 12712 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:18.350315 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 12468
I20260808 15:01:18.378571 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 12728
Aug 08 15:01:18 dist-test-slave-z8x9 krb5kdc[12253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.130@KRBTEST.COM
I20260808 15:01:18.395776 13249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:18.379442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50806 (local address 127.12.73.130:42425)
0808 15:01:18.379643 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:18.379649 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:18.379673 (+ 24us) server_negotiation.cc:407] Connection header received
0808 15:01:18.379822 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:18.379828 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:18.379913 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:18.380029 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:18.381356 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.382488 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.383756 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.384431 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.384557 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:18.389075 (+ 4518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:18.389093 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:18.389115 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:18.389155 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:18.392882 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:18.393673 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:18.393683 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:18.393687 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:18.393839 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:18.394188 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:18.394193 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:18.394197 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:18.394682 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:18.394985 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:18.395179 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 15:01:18.395407 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 15:01:18.396571 12955 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:18.485800 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 12728
I20260808 15:01:18.521556 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 12975
Aug 08 15:01:18 dist-test-slave-z8x9 krb5kdc[12253](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.131@KRBTEST.COM
I20260808 15:01:18.539801 13283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:18.522405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39458 (local address 127.12.73.131:39441)
0808 15:01:18.522609 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:18.522616 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:18.522639 (+ 23us) server_negotiation.cc:407] Connection header received
0808 15:01:18.522751 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:18.522758 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:18.522863 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:18.522983 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:18.524323 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.525594 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.526950 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:18.527623 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:18.527750 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:18.532452 (+ 4702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:18.532470 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:18.532493 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:18.532551 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:18.536780 (+ 4229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:18.537536 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:18.537545 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:18.537549 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:18.537730 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:18.538091 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:18.538097 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:18.538100 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:18.538613 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:18.538973 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:18.539162 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 15:01:18.539428 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 15:01:18.540604 13202 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:18.666292 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 12975
I20260808 15:01:18.694607 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 12279
I20260808 15:01:18.695756 12401 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:18.806568 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 12279
2026-08-08T15:01:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5183 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T15:01:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:18Z Disabled control of system clock
I20260808 15:01:18.906445 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:42053
--webserver_interface=127.12.73.190
--webserver_port=0
--builtin_ntp_servers=127.12.73.148:35515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:42053
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 15:01:19.246554 13328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:19.246876 13328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:19.246963 13328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:19.254149 13328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:19.254261 13328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:19.254305 13328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:19.254366 13328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:19.254411 13328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:19.263504 13328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:42053
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:42053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:19.264724 13328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:19.266446 13328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:19.277943 13340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:19.277912 13343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:19.278056 13348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:19.279064 13328 server_base.cc:1034] running on GCE node
I20260808 15:01:19.279834 13328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:19.281106 13328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:19.282363 13328 hybrid_clock.cc:648] HybridClock initialized: now 1786201279282318 us; error 38 us; skew 500 ppm
I20260808 15:01:19.282701 13328 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 15:01:19.293674 13328 webserver.cc:460] Webserver started at http://127.12.73.190:36089/ using document root <none> and password file <none>
I20260808 15:01:19.294384 13328 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:19.294525 13328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:19.294874 13328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:19.297840 13328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "55cb419a915644ccaa67cbbed8b3a8c7"
format_stamp: "Formatted at 2026-08-08 15:01:19 on dist-test-slave-z8x9"
server_key: "f9793e99a1ccf5b838532803e43ea8d7"
server_key_iv: "45f56f593cdaa08ae7901de81b15cf65"
server_key_version: "encryptionkey@0"
I20260808 15:01:19.298650 13328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "55cb419a915644ccaa67cbbed8b3a8c7"
format_stamp: "Formatted at 2026-08-08 15:01:19 on dist-test-slave-z8x9"
server_key: "f9793e99a1ccf5b838532803e43ea8d7"
server_key_iv: "45f56f593cdaa08ae7901de81b15cf65"
server_key_version: "encryptionkey@0"
I20260808 15:01:19.303668 13328 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260808 15:01:19.307060 13357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:19.308322 13328 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:01:19.308513 13328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "55cb419a915644ccaa67cbbed8b3a8c7"
format_stamp: "Formatted at 2026-08-08 15:01:19 on dist-test-slave-z8x9"
server_key: "f9793e99a1ccf5b838532803e43ea8d7"
server_key_iv: "45f56f593cdaa08ae7901de81b15cf65"
server_key_version: "encryptionkey@0"
I20260808 15:01:19.308725 13328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:19.327047 13328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:19.327845 13328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:19.328138 13328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:19.346778 13328 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:42053
I20260808 15:01:19.346801 13456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:42053 every 8 connection(s)
I20260808 15:01:19.348134 13328 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:19.353871 13461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:19.354530 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 13328
I20260808 15:01:19.354735 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:19.355216 12582 external_mini_cluster.cc:1428] Setting key d35314b38be6df9212790229ce1482fd
I20260808 15:01:19.368891 13461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7: Bootstrap starting.
I20260808 15:01:19.371174 13466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:19.357032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46992 (local address 127.12.73.190:42053)
0808 15:01:19.358411 (+ 1379us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:19.358425 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:19.358485 (+ 60us) server_negotiation.cc:407] Connection header received
0808 15:01:19.361141 (+ 2656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:19.361192 (+ 51us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:19.361761 (+ 569us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:19.362203 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:19.362743 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:19.364580 (+ 1837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:19.366024 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:19.367108 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:19.367283 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:19.368405 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:19.368416 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:19.368437 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:19.369117 (+ 680us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:19.369240 (+ 123us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:19.369283 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:19.369395 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:19.369608 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 15:01:19.369918 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":861,"thread_start_us":577,"threads_started":1}
I20260808 15:01:19.372810 13461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:19.374017 13461 log.cc:824] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:19.376485 13461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7: No bootstrap required, opened a new log
I20260808 15:01:19.383605 13461 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cb419a915644ccaa67cbbed8b3a8c7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42053 } }
I20260808 15:01:19.383955 13461 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:19.384079 13461 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55cb419a915644ccaa67cbbed8b3a8c7, State: Initialized, Role: FOLLOWER
I20260808 15:01:19.384876 13461 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cb419a915644ccaa67cbbed8b3a8c7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42053 } }
I20260808 15:01:19.385162 13469 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:01:19.385481 13469 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cb419a915644ccaa67cbbed8b3a8c7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42053 } }
I20260808 15:01:19.385128 13461 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:19.386165 13461 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:19.386137 13469 leader_election.cc:302] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55cb419a915644ccaa67cbbed8b3a8c7; no voters:
I20260808 15:01:19.386366 13461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:19.386965 13469 leader_election.cc:288] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260808 15:01:19.388883 13461 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cb419a915644ccaa67cbbed8b3a8c7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42053 } }
I20260808 15:01:19.389119 13461 leader_election.cc:302] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55cb419a915644ccaa67cbbed8b3a8c7; no voters:
I20260808 15:01:19.389259 13472 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260808 15:01:19.389393 13461 leader_election.cc:288] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:19.389739 13469 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:19.391345 13469 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [term 1 LEADER]: Becoming Leader. State: Replica: 55cb419a915644ccaa67cbbed8b3a8c7, State: Running, Role: LEADER
I20260808 15:01:19.391799 13469 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cb419a915644ccaa67cbbed8b3a8c7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42053 } }
I20260808 15:01:19.392633 13461 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:19.393992 13472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55cb419a915644ccaa67cbbed8b3a8c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cb419a915644ccaa67cbbed8b3a8c7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42053 } } }
I20260808 15:01:19.394054 13475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55cb419a915644ccaa67cbbed8b3a8c7. Latest consensus state: current_term: 1 leader_uuid: "55cb419a915644ccaa67cbbed8b3a8c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cb419a915644ccaa67cbbed8b3a8c7" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 42053 } } }
I20260808 15:01:19.394593 13475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:19.394613 13472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:19.396906 13483 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:19.402372 13483 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:19.410903 13483 catalog_manager.cc:1347] Generated new cluster ID: c5422772ae4c42c8bf58da36a5bdbc09
I20260808 15:01:19.411026 13483 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:19.419914 13483 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:19.421053 13483 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:19.428812 13483 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7: Generated new TSK 0
I20260808 15:01:19.429636 13483 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:19.441247 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.129:0
--local_ip_for_outbound_sockets=127.12.73.129
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:42053
--builtin_ntp_servers=127.12.73.148:35515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 15:01:19.785957 13512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:19.786252 13512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:19.786393 13512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:19.793933 13512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:19.794037 13512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:19.794245 13512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.129
I20260808 15:01:19.803869 13512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.73.129
--webserver_port=0
--tserver_master_addrs=127.12.73.190:42053
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.129
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:19.805298 13512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:19.807147 13512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:19.820343 13518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:19.820456 13517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:19.820411 13520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:19.821645 13512 server_base.cc:1034] running on GCE node
I20260808 15:01:19.822281 13512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:19.823185 13512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:19.824396 13512 hybrid_clock.cc:648] HybridClock initialized: now 1786201279824349 us; error 56 us; skew 500 ppm
I20260808 15:01:19.824736 13512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 15:01:19.827075 13512 webserver.cc:460] Webserver started at http://127.12.73.129:38397/ using document root <none> and password file <none>
I20260808 15:01:19.827780 13512 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:19.827901 13512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:19.828269 13512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:19.831241 13512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/data/instance:
uuid: "806c5a619ab64edb9408359b422a088c"
format_stamp: "Formatted at 2026-08-08 15:01:19 on dist-test-slave-z8x9"
server_key: "9f03c44f368001f1cfcd7bed46872053"
server_key_iv: "9402a83bad6776c5955005ae22bbcb56"
server_key_version: "encryptionkey@0"
I20260808 15:01:19.832033 13512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance:
uuid: "806c5a619ab64edb9408359b422a088c"
format_stamp: "Formatted at 2026-08-08 15:01:19 on dist-test-slave-z8x9"
server_key: "9f03c44f368001f1cfcd7bed46872053"
server_key_iv: "9402a83bad6776c5955005ae22bbcb56"
server_key_version: "encryptionkey@0"
I20260808 15:01:19.837394 13512 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260808 15:01:19.840858 13533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:19.842235 13512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:01:19.842442 13512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/wal
uuid: "806c5a619ab64edb9408359b422a088c"
format_stamp: "Formatted at 2026-08-08 15:01:19 on dist-test-slave-z8x9"
server_key: "9f03c44f368001f1cfcd7bed46872053"
server_key_iv: "9402a83bad6776c5955005ae22bbcb56"
server_key_version: "encryptionkey@0"
I20260808 15:01:19.842686 13512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:19.862119 13512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:19.862941 13512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:19.863273 13512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:19.864284 13512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:19.865794 13512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:19.865927 13512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:19.866063 13512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:19.866154 13512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:19.901690 13512 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.129:44403
I20260808 15:01:19.901743 13762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.129:44403 every 8 connection(s)
I20260808 15:01:19.903018 13512 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/data/info.pb
I20260808 15:01:19.904918 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 13512
I20260808 15:01:19.905118 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/wal/instance
I20260808 15:01:19.905751 12582 external_mini_cluster.cc:1428] Setting key b529ee651caa2bdbe5e751c76cad0a79
I20260808 15:01:19.908641 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.130:0
--local_ip_for_outbound_sockets=127.12.73.130
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:42053
--builtin_ntp_servers=127.12.73.148:35515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 15:01:19.917724 13773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:19.905964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.129:37595 (local address 127.12.73.190:42053)
0808 15:01:19.906425 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:19.906431 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:19.907985 (+ 1554us) server_negotiation.cc:407] Connection header received
0808 15:01:19.910371 (+ 2386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:19.910379 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:19.910475 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:19.910609 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:19.911642 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:19.912883 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:19.914544 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:19.915229 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:19.915388 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:19.916717 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:19.916726 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:19.916734 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:19.916759 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:19.916812 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:19.916831 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:19.916930 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:19.917138 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 15:01:19.917269 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":260,"threads_started":1}
I20260808 15:01:19.918483 13774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:19.906682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:42053 (local address 127.12.73.129:37595)
0808 15:01:19.907815 (+ 1133us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:19.907863 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:19.910062 (+ 2199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:19.910810 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:19.910818 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:19.910900 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:19.911477 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:19.911494 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:19.913042 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:19.913045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:19.914398 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:19.914411 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:19.915453 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:19.915458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:19.915649 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:19.916395 (+ 746us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:01:19.916398 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:19.916435 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:01:19.916513 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:19.916933 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:19.916942 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:19.916947 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 15:01:19.917084 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 15:01:19.917441 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":390,"threads_started":1}
I20260808 15:01:19.920056 13767 heartbeater.cc:347] Connected to a master server at 127.12.73.190:42053
I20260808 15:01:19.920400 13767 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:19.921443 13767 heartbeater.cc:511] Master 127.12.73.190:42053 requested a full tablet report, sending...
I20260808 15:01:19.923841 13386 ts_manager.cc:194] Registered new tserver with Master: 806c5a619ab64edb9408359b422a088c (127.12.73.129:44403)
I20260808 15:01:19.925761 13386 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.73.129:37595
W20260808 15:01:20.258028 13777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:20.258349 13777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:20.258512 13777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:20.265673 13777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:20.265765 13777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:20.265978 13777 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.130
I20260808 15:01:20.274926 13777 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.73.130
--webserver_port=0
--tserver_master_addrs=127.12.73.190:42053
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.130
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:20.276177 13777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:20.277997 13777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:20.289981 13785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:20.290959 13786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:20.291673 13790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:20.292410 13777 server_base.cc:1034] running on GCE node
I20260808 15:01:20.293123 13777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:20.294171 13777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:20.295389 13777 hybrid_clock.cc:648] HybridClock initialized: now 1786201280295347 us; error 33 us; skew 500 ppm
I20260808 15:01:20.295734 13777 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 15:01:20.298125 13777 webserver.cc:460] Webserver started at http://127.12.73.130:37075/ using document root <none> and password file <none>
I20260808 15:01:20.298817 13777 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:20.298940 13777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:20.299275 13777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:20.302150 13777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/data/instance:
uuid: "f2ccc7c572394e06856225aede92bff9"
format_stamp: "Formatted at 2026-08-08 15:01:20 on dist-test-slave-z8x9"
server_key: "f77e2af56747c81b8ec4343f809e8473"
server_key_iv: "80439dd883343a2bf45df0668de8556d"
server_key_version: "encryptionkey@0"
I20260808 15:01:20.302943 13777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance:
uuid: "f2ccc7c572394e06856225aede92bff9"
format_stamp: "Formatted at 2026-08-08 15:01:20 on dist-test-slave-z8x9"
server_key: "f77e2af56747c81b8ec4343f809e8473"
server_key_iv: "80439dd883343a2bf45df0668de8556d"
server_key_version: "encryptionkey@0"
I20260808 15:01:20.308095 13777 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 15:01:20.311862 13801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:20.313330 13777 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:01:20.313508 13777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/wal
uuid: "f2ccc7c572394e06856225aede92bff9"
format_stamp: "Formatted at 2026-08-08 15:01:20 on dist-test-slave-z8x9"
server_key: "f77e2af56747c81b8ec4343f809e8473"
server_key_iv: "80439dd883343a2bf45df0668de8556d"
server_key_version: "encryptionkey@0"
I20260808 15:01:20.313725 13777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:20.324491 13777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:20.325333 13777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:20.325636 13777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:20.326588 13777 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:20.327968 13777 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:20.328095 13777 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:20.328243 13777 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:20.328346 13777 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:20.371678 13777 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.130:37993
I20260808 15:01:20.371734 14020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.130:37993 every 8 connection(s)
I20260808 15:01:20.373026 13777 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/data/info.pb
I20260808 15:01:20.376227 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 13777
I20260808 15:01:20.376420 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/wal/instance
I20260808 15:01:20.377036 12582 external_mini_cluster.cc:1428] Setting key dd5400df4d6de231a4ee1e15aab4ae59
I20260808 15:01:20.380113 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.73.131:0
--local_ip_for_outbound_sockets=127.12.73.131
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:42053
--builtin_ntp_servers=127.12.73.148:35515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 15:01:20.386971 13773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:20.375652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:39337 (local address 127.12.73.190:42053)
0808 15:01:20.375890 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:20.375896 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:20.377531 (+ 1635us) server_negotiation.cc:407] Connection header received
0808 15:01:20.379395 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:20.379399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:20.379461 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:20.379539 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:20.380928 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.381653 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.384210 (+ 2557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.384576 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.384676 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:20.386277 (+ 1601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:20.386282 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:20.386285 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:20.386301 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:20.386333 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:20.386346 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:20.386417 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:20.386670 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 15:01:20.386742 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 15:01:20.388447 14023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:20.376152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:42053 (local address 127.12.73.130:39337)
0808 15:01:20.377363 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:20.377418 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:20.379100 (+ 1682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:20.379800 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:20.379812 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:20.379938 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:20.380756 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:20.380782 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.381799 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.381808 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:20.383947 (+ 2139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:20.383964 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.384815 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.384824 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:20.385151 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:20.385924 (+ 773us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:01:20.385930 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:20.385984 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:01:20.386087 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:20.386447 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:20.386461 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:20.386471 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 15:01:20.386657 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 15:01:20.387059 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":392,"threads_started":1}
I20260808 15:01:20.389881 14021 heartbeater.cc:347] Connected to a master server at 127.12.73.190:42053
I20260808 15:01:20.390192 14021 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:20.390916 14021 heartbeater.cc:511] Master 127.12.73.190:42053 requested a full tablet report, sending...
I20260808 15:01:20.392354 13386 ts_manager.cc:194] Registered new tserver with Master: f2ccc7c572394e06856225aede92bff9 (127.12.73.130:37993)
I20260808 15:01:20.393620 13386 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.73.130:39337
W20260808 15:01:20.728184 14024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:20.728472 14024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:20.728641 14024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:20.736260 14024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:20.736361 14024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:20.736543 14024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.73.131
I20260808 15:01:20.745461 14024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:35515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.73.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.73.131
--webserver_port=0
--tserver_master_addrs=127.12.73.190:42053
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.73.131
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:20.746912 14024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:20.748843 14024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:20.762151 14038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:20.762194 14033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:20.762231 14034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:20.762753 14024 server_base.cc:1034] running on GCE node
I20260808 15:01:20.763463 14024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:20.764411 14024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:20.765645 14024 hybrid_clock.cc:648] HybridClock initialized: now 1786201280765594 us; error 61 us; skew 500 ppm
I20260808 15:01:20.765974 14024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 15:01:20.768285 14024 webserver.cc:460] Webserver started at http://127.12.73.131:38975/ using document root <none> and password file <none>
I20260808 15:01:20.768996 14024 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:20.769134 14024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:20.769493 14024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:20.772315 14024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/data/instance:
uuid: "100f144eee6d4205b3a90fca00548372"
format_stamp: "Formatted at 2026-08-08 15:01:20 on dist-test-slave-z8x9"
server_key: "e9b280df3e86220452dcf830f8d32acb"
server_key_iv: "692b753cb70293907dd6e6a54131ece2"
server_key_version: "encryptionkey@0"
I20260808 15:01:20.773116 14024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance:
uuid: "100f144eee6d4205b3a90fca00548372"
format_stamp: "Formatted at 2026-08-08 15:01:20 on dist-test-slave-z8x9"
server_key: "e9b280df3e86220452dcf830f8d32acb"
server_key_iv: "692b753cb70293907dd6e6a54131ece2"
server_key_version: "encryptionkey@0"
I20260808 15:01:20.778187 14024 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260808 15:01:20.781610 14044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:20.782881 14024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:01:20.783061 14024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/wal
uuid: "100f144eee6d4205b3a90fca00548372"
format_stamp: "Formatted at 2026-08-08 15:01:20 on dist-test-slave-z8x9"
server_key: "e9b280df3e86220452dcf830f8d32acb"
server_key_iv: "692b753cb70293907dd6e6a54131ece2"
server_key_version: "encryptionkey@0"
I20260808 15:01:20.783280 14024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:20.799603 14024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:20.800410 14024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:20.800727 14024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:20.801779 14024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 15:01:20.803192 14024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 15:01:20.803328 14024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:20.803452 14024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 15:01:20.803541 14024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:20.838264 14024 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.131:42017
I20260808 15:01:20.838359 14254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.131:42017 every 8 connection(s)
I20260808 15:01:20.839574 14024 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/data/info.pb
I20260808 15:01:20.844854 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 14024
I20260808 15:01:20.845032 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/wal/instance
I20260808 15:01:20.845561 12582 external_mini_cluster.cc:1428] Setting key c398aaf514ac082e78f6d21ad2f900e1
I20260808 15:01:20.852334 13773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:20.842123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.131:59563 (local address 127.12.73.190:42053)
0808 15:01:20.842338 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:20.842342 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:20.843693 (+ 1351us) server_negotiation.cc:407] Connection header received
0808 15:01:20.845756 (+ 2063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:20.845763 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:20.845853 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:20.845972 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:20.847189 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.848035 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.849640 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.850054 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.850193 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:20.851496 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:20.851501 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:20.851504 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:20.851523 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:20.851555 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:20.851567 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:20.851675 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:20.851905 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 15:01:20.852003 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 15:01:20.853581 14260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:20.842612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:42053 (local address 127.12.73.131:59563)
0808 15:01:20.843529 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:20.843569 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:20.845449 (+ 1880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:20.846227 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:20.846235 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:20.846315 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:01:20.847015 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:20.847032 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.848193 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.848197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:20.849475 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:20.849487 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.850284 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.850292 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:20.850521 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:20.851183 (+ 662us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 15:01:20.851185 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:01:20.851224 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 15:01:20.851300 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:01:20.851675 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:01:20.851689 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:01:20.851704 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 15:01:20.851893 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 15:01:20.852277 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":289,"threads_started":1}
I20260808 15:01:20.854859 14255 heartbeater.cc:347] Connected to a master server at 127.12.73.190:42053
I20260808 15:01:20.855168 14255 heartbeater.cc:464] Registering TS with master...
I20260808 15:01:20.855929 14255 heartbeater.cc:511] Master 127.12.73.190:42053 requested a full tablet report, sending...
I20260808 15:01:20.857323 13386 ts_manager.cc:194] Registered new tserver with Master: 100f144eee6d4205b3a90fca00548372 (127.12.73.131:42017)
I20260808 15:01:20.858136 13386 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.73.131:59563
I20260808 15:01:20.860581 12582 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 15:01:20.870545 13773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:20.865328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47006 (local address 127.12.73.190:42053)
0808 15:01:20.865486 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:20.865490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:20.865959 (+ 469us) server_negotiation.cc:407] Connection header received
0808 15:01:20.866070 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:20.866074 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:20.866145 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:20.866221 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:20.866646 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.867312 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.868562 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.868936 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.869023 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:20.870030 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:20.870035 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:20.870038 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:20.870054 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:20.870085 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:20.870097 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:20.870165 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:20.870274 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 15:01:20.870342 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:01:20.874001 13386 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47006:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 15:01:20.880633 13386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 15:01:20.904675 14275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:20.892248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:42017 (local address 127.0.0.1:33122)
0808 15:01:20.894527 (+ 2279us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:20.894546 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:20.894684 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:20.895627 (+ 943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:20.895637 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:20.895672 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:20.896401 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:20.896413 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.898334 (+ 1921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.898338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:20.901323 (+ 2985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:20.901336 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.903482 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.903487 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:20.903789 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:20.903961 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 15:01:20.904089 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 15:01:20.904276 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2187,"mutex_wait_us":310,"thread_start_us":362,"threads_started":1}
I20260808 15:01:20.905705 14276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:20.892218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.130:37993 (local address 127.0.0.1:50968)
0808 15:01:20.893030 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:20.893086 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:20.893339 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:20.895723 (+ 2384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:20.895728 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:20.895756 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:20.896195 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:20.896210 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.898302 (+ 2092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.898307 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:20.901223 (+ 2916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:20.901245 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.903454 (+ 2209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.903467 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:20.903791 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:20.903961 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 15:01:20.904089 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 15:01:20.905171 (+ 1082us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"mutex_wait_us":1175,"thread_start_us":2051,"threads_started":1}
I20260808 15:01:20.905754 14277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:20.892359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33122 (local address 127.12.73.131:42017)
0808 15:01:20.894032 (+ 1673us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:20.894044 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:20.894649 (+ 605us) server_negotiation.cc:407] Connection header received
0808 15:01:20.894869 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:20.894880 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:20.895131 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:20.895318 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:20.896628 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.898183 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.901531 (+ 3348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.902921 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.903055 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:20.903332 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:20.905238 (+ 1906us) server_negotiation.cc:299] Negotiation successful
0808 15:01:20.905395 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1470,"thread_start_us":1294,"threads_started":1}
I20260808 15:01:20.906162 14278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:20.892806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50968 (local address 127.12.73.130:37993)
0808 15:01:20.895154 (+ 2348us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:20.895165 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:20.895195 (+ 30us) server_negotiation.cc:407] Connection header received
0808 15:01:20.895289 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:20.895296 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:20.895519 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:20.896153 (+ 634us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:20.896426 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.898135 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.901466 (+ 3331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.902920 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.903055 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:20.903293 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:20.904222 (+ 929us) server_negotiation.cc:299] Negotiation successful
0808 15:01:20.904405 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2204,"thread_start_us":2093,"threads_started":1}
I20260808 15:01:20.909547 14123 tablet_service.cc:1467] Processing CreateTablet for tablet ed13df2c38f54066a27a5aa381d2f673 (DEFAULT_TABLE table=test-table [id=399cc75b52ed44e083cce0e129783736]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:20.910610 13885 tablet_service.cc:1467] Processing CreateTablet for tablet ed13df2c38f54066a27a5aa381d2f673 (DEFAULT_TABLE table=test-table [id=399cc75b52ed44e083cce0e129783736]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:20.911129 14123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed13df2c38f54066a27a5aa381d2f673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:20.911734 13885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed13df2c38f54066a27a5aa381d2f673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:20.913712 14275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:20.894649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44403 (local address 127.0.0.1:37562)
0808 15:01:20.904943 (+ 10294us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:20.904964 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:20.905057 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:20.906968 (+ 1911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:20.906973 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:20.906997 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:20.907136 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:20.907145 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.909070 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.909074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:20.910847 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:20.910862 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.912929 (+ 2067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.912937 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:20.913145 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:20.913208 (+ 63us) client_negotiation.cc:769] Sending connection context
0808 15:01:20.913296 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 15:01:20.913429 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10200,"thread_start_us":12617,"threads_started":1}
I20260808 15:01:20.914532 14281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:20.894974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37562 (local address 127.12.73.129:44403)
0808 15:01:20.906169 (+ 11195us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:20.906177 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:20.906212 (+ 35us) server_negotiation.cc:407] Connection header received
0808 15:01:20.906312 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:20.906320 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:20.906540 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:20.906724 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:20.907298 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.908896 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.911054 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:20.912404 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:20.912539 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:20.912813 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:20.914006 (+ 1193us) server_negotiation.cc:299] Negotiation successful
0808 15:01:20.914186 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11014,"thread_start_us":14847,"threads_started":1}
I20260808 15:01:20.922875 14285 tablet_bootstrap.cc:492] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9: Bootstrap starting.
I20260808 15:01:20.922891 14286 tablet_bootstrap.cc:492] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372: Bootstrap starting.
I20260808 15:01:20.926383 14285 tablet_bootstrap.cc:654] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:20.927181 14286 tablet_bootstrap.cc:654] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:20.926748 13643 tablet_service.cc:1467] Processing CreateTablet for tablet ed13df2c38f54066a27a5aa381d2f673 (DEFAULT_TABLE table=test-table [id=399cc75b52ed44e083cce0e129783736]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 15:01:20.927485 14285 log.cc:824] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:20.928256 13643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed13df2c38f54066a27a5aa381d2f673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:20.928370 14286 log.cc:824] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:20.929445 13767 heartbeater.cc:503] Master 127.12.73.190:42053 was elected leader, sending a full tablet report...
I20260808 15:01:20.930749 14285 tablet_bootstrap.cc:492] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9: No bootstrap required, opened a new log
I20260808 15:01:20.931090 14285 ts_tablet_manager.cc:1397] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20260808 15:01:20.931685 14286 tablet_bootstrap.cc:492] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372: No bootstrap required, opened a new log
I20260808 15:01:20.931974 14286 ts_tablet_manager.cc:1397] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260808 15:01:20.941059 14289 tablet_bootstrap.cc:492] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c: Bootstrap starting.
I20260808 15:01:20.941902 14285 raft_consensus.cc:348] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100f144eee6d4205b3a90fca00548372" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 42017 } } peers { permanent_uuid: "f2ccc7c572394e06856225aede92bff9" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37993 } } peers { permanent_uuid: "806c5a619ab64edb9408359b422a088c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44403 } }
I20260808 15:01:20.942366 14285 raft_consensus.cc:374] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:20.942528 14285 raft_consensus.cc:729] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ccc7c572394e06856225aede92bff9, State: Initialized, Role: FOLLOWER
I20260808 15:01:20.942507 14286 raft_consensus.cc:348] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100f144eee6d4205b3a90fca00548372" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 42017 } } peers { permanent_uuid: "f2ccc7c572394e06856225aede92bff9" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37993 } } peers { permanent_uuid: "806c5a619ab64edb9408359b422a088c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44403 } }
I20260808 15:01:20.942946 14286 raft_consensus.cc:374] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:20.943053 14286 raft_consensus.cc:729] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 100f144eee6d4205b3a90fca00548372, State: Initialized, Role: FOLLOWER
I20260808 15:01:20.943169 14285 consensus_queue.cc:260] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100f144eee6d4205b3a90fca00548372" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 42017 } } peers { permanent_uuid: "f2ccc7c572394e06856225aede92bff9" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37993 } } peers { permanent_uuid: "806c5a619ab64edb9408359b422a088c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44403 } }
I20260808 15:01:20.943606 14286 consensus_queue.cc:260] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100f144eee6d4205b3a90fca00548372" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 42017 } } peers { permanent_uuid: "f2ccc7c572394e06856225aede92bff9" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37993 } } peers { permanent_uuid: "806c5a619ab64edb9408359b422a088c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44403 } }
I20260808 15:01:20.944353 14289 tablet_bootstrap.cc:654] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:20.944618 14021 heartbeater.cc:503] Master 127.12.73.190:42053 was elected leader, sending a full tablet report...
I20260808 15:01:20.945488 14285 ts_tablet_manager.cc:1428] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260808 15:01:20.945749 14289 log.cc:824] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:20.946540 14255 heartbeater.cc:503] Master 127.12.73.190:42053 was elected leader, sending a full tablet report...
I20260808 15:01:20.947757 14286 ts_tablet_manager.cc:1428] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260808 15:01:20.949055 14289 tablet_bootstrap.cc:492] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c: No bootstrap required, opened a new log
I20260808 15:01:20.949388 14289 ts_tablet_manager.cc:1397] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 15:01:20.956998 14289 raft_consensus.cc:348] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100f144eee6d4205b3a90fca00548372" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 42017 } } peers { permanent_uuid: "f2ccc7c572394e06856225aede92bff9" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37993 } } peers { permanent_uuid: "806c5a619ab64edb9408359b422a088c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44403 } }
I20260808 15:01:20.957435 14289 raft_consensus.cc:374] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:20.957543 14289 raft_consensus.cc:729] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 806c5a619ab64edb9408359b422a088c, State: Initialized, Role: FOLLOWER
I20260808 15:01:20.958065 14289 consensus_queue.cc:260] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100f144eee6d4205b3a90fca00548372" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 42017 } } peers { permanent_uuid: "f2ccc7c572394e06856225aede92bff9" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37993 } } peers { permanent_uuid: "806c5a619ab64edb9408359b422a088c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44403 } }
I20260808 15:01:20.959601 14289 ts_tablet_manager.cc:1428] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
W20260808 15:01:21.091425 14259 tablet.cc:2369] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:01:21.125370 14022 tablet.cc:2369] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 15:01:21.155740 13772 tablet.cc:2369] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:01:21.221158 14291 raft_consensus.cc:482] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 15:01:21.221558 14291 raft_consensus.cc:504] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100f144eee6d4205b3a90fca00548372" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 42017 } } peers { permanent_uuid: "f2ccc7c572394e06856225aede92bff9" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37993 } } peers { permanent_uuid: "806c5a619ab64edb9408359b422a088c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44403 } }
I20260808 15:01:21.223424 14291 leader_election.cc:288] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 100f144eee6d4205b3a90fca00548372 (127.12.73.131:42017), 806c5a619ab64edb9408359b422a088c (127.12.73.129:44403)
I20260808 15:01:21.230376 14281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.223996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:42195 (local address 127.12.73.129:44403)
0808 15:01:21.224203 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:21.224211 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:21.224939 (+ 728us) server_negotiation.cc:407] Connection header received
0808 15:01:21.225084 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:21.225088 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:21.225212 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:21.225306 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:21.225928 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.226604 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.228484 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.229411 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.229563 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:21.229655 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:21.229984 (+ 329us) server_negotiation.cc:299] Negotiation successful
0808 15:01:21.230118 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:01:21.230456 14277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.223840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.73.130:50689 (local address 127.12.73.131:42017)
0808 15:01:21.224090 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:21.224097 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:21.224781 (+ 684us) server_negotiation.cc:407] Connection header received
0808 15:01:21.224949 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:21.224955 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:21.225043 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:21.225128 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 15:01:21.225849 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.226589 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.228577 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.229452 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.229634 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:21.229701 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:21.230089 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 15:01:21.230222 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 15:01:21.230492 14299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.223755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44403 (local address 127.12.73.130:42195)
0808 15:01:21.224801 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:21.224820 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:21.224961 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:21.225363 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:21.225366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:21.225399 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:21.225782 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:21.225793 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.226774 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.226778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:21.228265 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:21.228277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.229606 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.229613 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:21.229806 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:21.229849 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 15:01:21.229922 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 15:01:21.230033 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":904,"mutex_wait_us":32,"thread_start_us":582,"threads_started":1}
I20260808 15:01:21.230553 14297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.223618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.131:42017 (local address 127.12.73.130:50689)
0808 15:01:21.224642 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:21.224663 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 15:01:21.224801 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:01:21.225202 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:01:21.225207 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:01:21.225234 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 15:01:21.225664 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:21.225683 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.226727 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.226732 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:21.228330 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:01:21.228343 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.229667 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.229676 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:01:21.229883 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:21.229935 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 15:01:21.230031 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 15:01:21.230162 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":912,"mutex_wait_us":134,"thread_start_us":663,"threads_started":1}
I20260808 15:01:21.231519 13674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed13df2c38f54066a27a5aa381d2f673" candidate_uuid: "f2ccc7c572394e06856225aede92bff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "806c5a619ab64edb9408359b422a088c" is_pre_election: true
I20260808 15:01:21.231521 14167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed13df2c38f54066a27a5aa381d2f673" candidate_uuid: "f2ccc7c572394e06856225aede92bff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "100f144eee6d4205b3a90fca00548372" is_pre_election: true
I20260808 15:01:21.232013 14167 raft_consensus.cc:2454] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ccc7c572394e06856225aede92bff9 in term 0.
I20260808 15:01:21.232017 13674 raft_consensus.cc:2454] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ccc7c572394e06856225aede92bff9 in term 0.
I20260808 15:01:21.232710 13804 leader_election.cc:302] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 100f144eee6d4205b3a90fca00548372, 806c5a619ab64edb9408359b422a088c, f2ccc7c572394e06856225aede92bff9; no voters:
I20260808 15:01:21.233103 14291 raft_consensus.cc:2781] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 15:01:21.233335 14291 raft_consensus.cc:482] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 15:01:21.233453 14291 raft_consensus.cc:3037] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:21.235685 14291 raft_consensus.cc:504] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100f144eee6d4205b3a90fca00548372" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 42017 } } peers { permanent_uuid: "f2ccc7c572394e06856225aede92bff9" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37993 } } peers { permanent_uuid: "806c5a619ab64edb9408359b422a088c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44403 } }
I20260808 15:01:21.236284 14291 leader_election.cc:288] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [CANDIDATE]: Term 1 election: Requested vote from peers 100f144eee6d4205b3a90fca00548372 (127.12.73.131:42017), 806c5a619ab64edb9408359b422a088c (127.12.73.129:44403)
I20260808 15:01:21.236699 14167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed13df2c38f54066a27a5aa381d2f673" candidate_uuid: "f2ccc7c572394e06856225aede92bff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "100f144eee6d4205b3a90fca00548372"
I20260808 15:01:21.236734 13674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed13df2c38f54066a27a5aa381d2f673" candidate_uuid: "f2ccc7c572394e06856225aede92bff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "806c5a619ab64edb9408359b422a088c"
I20260808 15:01:21.236893 14167 raft_consensus.cc:3037] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:21.236929 13674 raft_consensus.cc:3037] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:21.239115 14167 raft_consensus.cc:2454] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ccc7c572394e06856225aede92bff9 in term 1.
I20260808 15:01:21.239193 13674 raft_consensus.cc:2454] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ccc7c572394e06856225aede92bff9 in term 1.
I20260808 15:01:21.239564 13804 leader_election.cc:302] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 100f144eee6d4205b3a90fca00548372, 806c5a619ab64edb9408359b422a088c, f2ccc7c572394e06856225aede92bff9; no voters:
I20260808 15:01:21.239862 14291 raft_consensus.cc:2781] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:21.240298 14291 raft_consensus.cc:686] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 1 LEADER]: Becoming Leader. State: Replica: f2ccc7c572394e06856225aede92bff9, State: Running, Role: LEADER
I20260808 15:01:21.240751 14291 consensus_queue.cc:237] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100f144eee6d4205b3a90fca00548372" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 42017 } } peers { permanent_uuid: "f2ccc7c572394e06856225aede92bff9" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37993 } } peers { permanent_uuid: "806c5a619ab64edb9408359b422a088c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44403 } }
I20260808 15:01:21.245635 13386 catalog_manager.cc:5495] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ccc7c572394e06856225aede92bff9 (127.12.73.130). New cstate: current_term: 1 leader_uuid: "f2ccc7c572394e06856225aede92bff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100f144eee6d4205b3a90fca00548372" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ccc7c572394e06856225aede92bff9" member_type: VOTER last_known_addr { host: "127.12.73.130" port: 37993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "806c5a619ab64edb9408359b422a088c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44403 } health_report { overall_health: UNKNOWN } } }
I20260808 15:01:21.277057 14278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.271607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50980 (local address 127.12.73.130:37993)
0808 15:01:21.271834 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:21.271840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:21.271860 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:01:21.272099 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:21.272103 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:21.272193 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:21.272350 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:01:21.272737 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.273530 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.274963 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.275379 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.275514 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:21.275980 (+ 466us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:01:21.276484 (+ 504us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:01:21.276653 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:21.276721 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 15:01:21.276799 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 15:01:21.284727 13674 raft_consensus.cc:1261] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c [term 1 FOLLOWER]: Refusing update from remote peer f2ccc7c572394e06856225aede92bff9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:01:21.284744 14167 raft_consensus.cc:1261] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372 [term 1 FOLLOWER]: Refusing update from remote peer f2ccc7c572394e06856225aede92bff9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:01:21.285718 14300 consensus_queue.cc:1035] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "806c5a619ab64edb9408359b422a088c" member_type: VOTER last_known_addr { host: "127.12.73.129" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:01:21.286051 14291 consensus_queue.cc:1035] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "100f144eee6d4205b3a90fca00548372" member_type: VOTER last_known_addr { host: "127.12.73.131" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:01:21.308065 13385 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:01:21.308362 13385 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 15:01:21.312018 13385 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 55cb419a915644ccaa67cbbed8b3a8c7: Sending DeleteTablet for 3 replicas of tablet ed13df2c38f54066a27a5aa381d2f673
I20260808 15:01:21.313158 14123 tablet_service.cc:1514] Processing DeleteTablet for tablet ed13df2c38f54066a27a5aa381d2f673 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:21 UTC) from {username='slave'} at 127.0.0.1:33122
I20260808 15:01:21.313254 13643 tablet_service.cc:1514] Processing DeleteTablet for tablet ed13df2c38f54066a27a5aa381d2f673 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:21 UTC) from {username='slave'} at 127.0.0.1:37562
I20260808 15:01:21.313352 13885 tablet_service.cc:1514] Processing DeleteTablet for tablet ed13df2c38f54066a27a5aa381d2f673 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 15:01:21 UTC) from {username='slave'} at 127.0.0.1:50968
I20260808 15:01:21.315790 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 13512
I20260808 15:01:21.321655 14321 tablet_replica.cc:330] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c: stopping tablet replica
I20260808 15:01:21.322024 14321 raft_consensus.cc:2229] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:01:21.322474 14321 raft_consensus.cc:2258] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:21.327076 14321 ts_tablet_manager.cc:1905] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:21.327687 14322 tablet_replica.cc:330] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9: stopping tablet replica
I20260808 15:01:21.328605 14320 tablet_replica.cc:330] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372: stopping tablet replica
I20260808 15:01:21.329156 14320 raft_consensus.cc:2229] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 15:01:21.329756 14320 raft_consensus.cc:2258] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:21.329834 14322 raft_consensus.cc:2229] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 15:01:21.330747 14322 raft_consensus.cc:2258] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 15:01:21.332665 14320 ts_tablet_manager.cc:1905] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:21.334491 14322 ts_tablet_manager.cc:1905] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 15:01:21.336791 14281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.317429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37566 (local address 127.12.73.129:44403)
0808 15:01:21.317654 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:21.317664 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:21.327957 (+ 10293us) server_negotiation.cc:407] Connection header received
0808 15:01:21.328158 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:21.328166 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:21.328292 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:21.328400 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:21.329070 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.330272 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.331856 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.332488 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.332608 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:21.335041 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:21.335054 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:21.335070 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:21.335826 (+ 756us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:21.335904 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:21.335929 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:21.336009 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:21.336274 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 15:01:21.336393 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 15:01:21.338006 13756 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:21.338083 14321 ts_tablet_manager.cc:1918] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:21.338245 14321 log.cc:1196] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-0/wal/wals/ed13df2c38f54066a27a5aa381d2f673
I20260808 15:01:21.340956 14320 ts_tablet_manager.cc:1918] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:21.341189 14320 log.cc:1196] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-2/wal/wals/ed13df2c38f54066a27a5aa381d2f673
I20260808 15:01:21.341874 14320 ts_tablet_manager.cc:1939] T ed13df2c38f54066a27a5aa381d2f673 P 100f144eee6d4205b3a90fca00548372: Deleting consensus metadata
I20260808 15:01:21.344247 13361 catalog_manager.cc:4841] TS 100f144eee6d4205b3a90fca00548372 (127.12.73.131:42017): tablet ed13df2c38f54066a27a5aa381d2f673 (table test-table [id=399cc75b52ed44e083cce0e129783736]) successfully deleted
I20260808 15:01:21.345129 14322 ts_tablet_manager.cc:1918] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 15:01:21.345400 14322 log.cc:1196] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9: Deleting WAL directory at /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200952883082-12582-0/minicluster-data/ts-1/wal/wals/ed13df2c38f54066a27a5aa381d2f673
I20260808 15:01:21.346132 14322 ts_tablet_manager.cc:1939] T ed13df2c38f54066a27a5aa381d2f673 P f2ccc7c572394e06856225aede92bff9: Deleting consensus metadata
I20260808 15:01:21.348467 13358 catalog_manager.cc:4841] TS f2ccc7c572394e06856225aede92bff9 (127.12.73.130:37993): tablet ed13df2c38f54066a27a5aa381d2f673 (table test-table [id=399cc75b52ed44e083cce0e129783736]) successfully deleted
I20260808 15:01:21.466403 14321 ts_tablet_manager.cc:1939] T ed13df2c38f54066a27a5aa381d2f673 P 806c5a619ab64edb9408359b422a088c: Deleting consensus metadata
I20260808 15:01:21.466431 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 13512
I20260808 15:01:21.491722 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 13777
W20260808 15:01:21.491714 13358 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.73.129:44403 (error 108)
I20260808 15:01:21.494555 14332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.493429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44403 (local address 127.0.0.1:37568)
0808 15:01:21.494287 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:21.494389 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":721,"thread_start_us":636,"threads_started":1}
W20260808 15:01:21.494814 13358 catalog_manager.cc:4584] TS 806c5a619ab64edb9408359b422a088c (127.12.73.129:44403): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ed13df2c38f54066a27a5aa381d2f673: Network error: Client connection negotiation failed: client connection to 127.12.73.129:44403: connect: Connection refused (error 111)
I20260808 15:01:21.500388 14278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.492886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50988 (local address 127.12.73.130:37993)
0808 15:01:21.493124 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:21.493131 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:21.493151 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:01:21.493435 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:21.493441 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:21.493565 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:21.493726 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:21.494237 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.495448 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.496878 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.497568 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.497694 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:21.498771 (+ 1077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:21.498784 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:21.498803 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:21.499600 (+ 797us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:21.499665 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:21.499696 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:21.499808 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:21.499895 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 15:01:21.499995 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 15:01:21.501153 14011 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:21.548456 14332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.547967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44403 (local address 127.0.0.1:37574)
0808 15:01:21.548206 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:21.548298 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 15:01:21.549681 14332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.549282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44403 (local address 127.0.0.1:37584)
0808 15:01:21.549460 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:21.549539 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 15:01:21.610421 14332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.609803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44403 (local address 127.0.0.1:37598)
0808 15:01:21.610084 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:21.610188 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260808 15:01:21.612012 14332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.611310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44403 (local address 127.0.0.1:37604)
0808 15:01:21.611718 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:21.611835 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 15:01:21.612586 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 13777
I20260808 15:01:21.642004 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 14024
I20260808 15:01:21.649159 14277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.642794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33136 (local address 127.12.73.131:42017)
0808 15:01:21.642998 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:21.643005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:21.643141 (+ 136us) server_negotiation.cc:407] Connection header received
0808 15:01:21.643370 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:21.643374 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:21.643456 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:21.643580 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:21.643991 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.644717 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.646082 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:21.646491 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:21.646636 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:21.647768 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:21.647777 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:21.647792 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:21.648396 (+ 604us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:21.648444 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:21.648463 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:21.648595 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:21.648725 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 15:01:21.648833 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:01:21.650024 14248 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:21.693084 14332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.692585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44403 (local address 127.0.0.1:37606)
0808 15:01:21.692852 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:21.692945 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 15:01:21.694267 14332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:21.693845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.129:44403 (local address 127.0.0.1:37610)
0808 15:01:21.694056 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 15:01:21.694124 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.129:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 15:01:21.739581 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 14024
I20260808 15:01:21.768529 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 13328
I20260808 15:01:21.769744 13448 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:21.877872 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 13328
2026-08-08T15:01:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3069 ms)
[----------] 6 tests from EncryptionPolicyTest (23876 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:22 dist-test-slave-z8x9 krb5kdc[14340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:22 dist-test-slave-z8x9 krb5kdc[14340](info): set up 2 sockets
Aug 08 15:01:22 dist-test-slave-z8x9 krb5kdc[14340](info): commencing operation
krb5kdc: starting...
W20260808 15:01:23.259464 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.331s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:23 dist-test-slave-z8x9 krb5kdc[14340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:01:23.580675 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37465
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37465
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:23.920811 14367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:23.921098 14367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:23.921222 14367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:23.928323 14367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:23.928433 14367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:23.928488 14367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:23.928550 14367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:23.928596 14367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:23.938301 14367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37465
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:23.939495 14367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:23.940723 14367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:23.952458 14379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:23.952709 14376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:23.952669 14377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:23.953668 14367 server_base.cc:1034] running on GCE node
I20260808 15:01:23.954447 14367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:23.955767 14367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:23.956965 14367 hybrid_clock.cc:648] HybridClock initialized: now 1786201283956906 us; error 51 us; skew 500 ppm
I20260808 15:01:23.957355 14367 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:23 dist-test-slave-z8x9 krb5kdc[14340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201283, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:23.960466 14367 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:01:23.962034 14367 webserver.cc:460] Webserver started at http://127.0.0.1:41151/ using document root <none> and password file <none>
I20260808 15:01:23.962677 14367 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:23.962777 14367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:23.963020 14367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:23.965984 14367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "65839c566d304bfda5fa50986e4feaad"
format_stamp: "Formatted at 2026-08-08 15:01:23 on dist-test-slave-z8x9"
server_key: "2a29141c19a81787a1f24dbd2c0441e4"
server_key_iv: "759d923d16ea79fda8c95fdebdafeb56"
server_key_version: "encryptionkey@0"
I20260808 15:01:23.966737 14367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "65839c566d304bfda5fa50986e4feaad"
format_stamp: "Formatted at 2026-08-08 15:01:23 on dist-test-slave-z8x9"
server_key: "2a29141c19a81787a1f24dbd2c0441e4"
server_key_iv: "759d923d16ea79fda8c95fdebdafeb56"
server_key_version: "encryptionkey@0"
I20260808 15:01:23.971695 14367 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 15:01:23.975123 14396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:23.976408 14367 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:01:23.976598 14367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "65839c566d304bfda5fa50986e4feaad"
format_stamp: "Formatted at 2026-08-08 15:01:23 on dist-test-slave-z8x9"
server_key: "2a29141c19a81787a1f24dbd2c0441e4"
server_key_iv: "759d923d16ea79fda8c95fdebdafeb56"
server_key_version: "encryptionkey@0"
I20260808 15:01:23.976792 14367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:24.007890 14367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:24.011950 14367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:24.012247 14367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:24.031090 14367 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37465
I20260808 15:01:24.031128 14481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37465 every 8 connection(s)
I20260808 15:01:24.032415 14367 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:24.036022 14482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:24.042196 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 14367
I20260808 15:01:24.042426 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:24.043074 12582 external_mini_cluster.cc:1428] Setting key 00033e3633823dad8bd86797062e6bce
I20260808 15:01:24.047070 14482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad: Bootstrap starting.
I20260808 15:01:24.050833 14482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:24.052207 14482 log.cc:824] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:24.055292 14482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad: No bootstrap required, opened a new log
Aug 08 15:01:24 dist-test-slave-z8x9 krb5kdc[14340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 15:01:24.064584 14482 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65839c566d304bfda5fa50986e4feaad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } }
I20260808 15:01:24.065069 14482 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:24.065244 14482 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65839c566d304bfda5fa50986e4feaad, State: Initialized, Role: FOLLOWER
I20260808 15:01:24.065956 14482 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65839c566d304bfda5fa50986e4feaad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } }
I20260808 15:01:24.066260 14482 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:24.066421 14482 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:24.066638 14482 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:24.069051 14487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:24.045072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44529 (local address 127.0.0.1:37465)
0808 15:01:24.045949 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:24.045964 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:24.046013 (+ 49us) server_negotiation.cc:407] Connection header received
0808 15:01:24.048418 (+ 2405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:24.048444 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:24.048976 (+ 532us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:24.049430 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:24.050690 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:24.052798 (+ 2108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:24.054369 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:24.055401 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:24.055574 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:24.059748 (+ 4174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:24.059763 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:24.059782 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:24.059829 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:24.063928 (+ 4099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:24.064834 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:24.064842 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:24.064850 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:24.065090 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:24.065683 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:24.065688 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:24.065691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:24.066424 (+ 733us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:24.066761 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:24.067273 (+ 512us) server_negotiation.cc:299] Negotiation successful
0808 15:01:24.067633 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":344,"threads_started":1}
I20260808 15:01:24.070070 14482 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65839c566d304bfda5fa50986e4feaad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } }
I20260808 15:01:24.070638 14482 leader_election.cc:302] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65839c566d304bfda5fa50986e4feaad; no voters:
I20260808 15:01:24.071265 14482 leader_election.cc:288] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:24.071421 14491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:24.072897 14491 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [term 1 LEADER]: Becoming Leader. State: Replica: 65839c566d304bfda5fa50986e4feaad, State: Running, Role: LEADER
I20260808 15:01:24.073626 14482 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:24.073532 14491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65839c566d304bfda5fa50986e4feaad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } }
I20260808 15:01:24.073850 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:24.076099 14493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65839c566d304bfda5fa50986e4feaad. Latest consensus state: current_term: 1 leader_uuid: "65839c566d304bfda5fa50986e4feaad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65839c566d304bfda5fa50986e4feaad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } } }
I20260808 15:01:24.076494 14493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:24.077035 14492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65839c566d304bfda5fa50986e4feaad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65839c566d304bfda5fa50986e4feaad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } } }
I20260808 15:01:24.077437 14492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:24.084749 14499 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:24.090559 14499 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:24.102246 14499 catalog_manager.cc:1347] Generated new cluster ID: 88d08277578648089ec6b1179887f3c3
I20260808 15:01:24.102396 14499 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:24.116258 14487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:24.087346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47559 (local address 127.0.0.1:37465)
0808 15:01:24.087535 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:24.087542 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:24.094454 (+ 6912us) server_negotiation.cc:407] Connection header received
0808 15:01:24.094646 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:24.094653 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:24.094738 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:24.094831 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:24.100942 (+ 6111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:24.102167 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:24.104137 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:24.104859 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:24.104972 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:24.108547 (+ 3575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:24.108559 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:24.108564 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:24.108605 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:24.112422 (+ 3817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:24.113493 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:24.113499 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:24.113502 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:24.113661 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:24.114286 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:24.114291 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:24.114294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:24.114685 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:24.114945 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:24.115671 (+ 726us) server_negotiation.cc:299] Negotiation successful
0808 15:01:24.115865 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 15:01:24.130723 14499 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:24.132016 14499 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:24.140594 14499 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65839c566d304bfda5fa50986e4feaad: Generated new TSK 0
I20260808 15:01:24.141456 14499 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:24.151145 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 14367
I20260808 15:01:24.152302 14475 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:24.245844 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 14367
W20260808 15:01:24.271234 14337 connection.cc:535] client connection to 127.0.0.1:37465 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37465): Connection reset by peer (error 104)
2026-08-08T15:01:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2362 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:24 dist-test-slave-z8x9 krb5kdc[14537](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:24 dist-test-slave-z8x9 krb5kdc[14537](info): set up 2 sockets
Aug 08 15:01:24 dist-test-slave-z8x9 krb5kdc[14537](info): commencing operation
krb5kdc: starting...
W20260808 15:01:25.624627 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.334s user 0.001s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:25 dist-test-slave-z8x9 krb5kdc[14537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:01:25.940495 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42641
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42641
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:26.279237 14562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:26.279525 14562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:26.279673 14562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:26.286720 14562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:26.286863 14562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:26.286958 14562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:26.287065 14562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:26.287133 14562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:26.296684 14562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42641
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:26.298055 14562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:26.299350 14562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:26.311167 14575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:26.311282 14572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:26.311255 14573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:26.311883 14562 server_base.cc:1034] running on GCE node
I20260808 15:01:26.312620 14562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:26.313944 14562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:26.315145 14562 hybrid_clock.cc:648] HybridClock initialized: now 1786201286315112 us; error 24 us; skew 500 ppm
I20260808 15:01:26.315481 14562 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:26 dist-test-slave-z8x9 krb5kdc[14537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201286, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:26.318630 14562 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:01:26.320061 14562 webserver.cc:460] Webserver started at http://127.0.0.1:39181/ using document root <none> and password file <none>
I20260808 15:01:26.320705 14562 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:26.320807 14562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:26.321054 14562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:26.323942 14562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "3f48a9d4e53f4b07bc769a4aa68daba1"
format_stamp: "Formatted at 2026-08-08 15:01:26 on dist-test-slave-z8x9"
server_key: "2f811df494b212eea1e209ada3475763"
server_key_iv: "9e2bdc16ba5227ee964696a4ccf19375"
server_key_version: "encryptionkey@0"
I20260808 15:01:26.324630 14562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "3f48a9d4e53f4b07bc769a4aa68daba1"
format_stamp: "Formatted at 2026-08-08 15:01:26 on dist-test-slave-z8x9"
server_key: "2f811df494b212eea1e209ada3475763"
server_key_iv: "9e2bdc16ba5227ee964696a4ccf19375"
server_key_version: "encryptionkey@0"
I20260808 15:01:26.329479 14562 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 15:01:26.332688 14588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:26.333941 14562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:01:26.334121 14562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "3f48a9d4e53f4b07bc769a4aa68daba1"
format_stamp: "Formatted at 2026-08-08 15:01:26 on dist-test-slave-z8x9"
server_key: "2f811df494b212eea1e209ada3475763"
server_key_iv: "9e2bdc16ba5227ee964696a4ccf19375"
server_key_version: "encryptionkey@0"
I20260808 15:01:26.334311 14562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:26.362651 14562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:26.366617 14562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:26.366909 14562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:26.386363 14562 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42641
I20260808 15:01:26.386368 14684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42641 every 8 connection(s)
I20260808 15:01:26.387697 14562 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:26.391513 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 14562
I20260808 15:01:26.391687 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:26.391819 14686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:26.392211 12582 external_mini_cluster.cc:1428] Setting key 05ab37debe9838c48bc82387896d7d49
I20260808 15:01:26.407166 14690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:26.394005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53513 (local address 127.0.0.1:42641)
0808 15:01:26.394917 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:26.394931 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:26.394990 (+ 59us) server_negotiation.cc:407] Connection header received
0808 15:01:26.396925 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:26.396952 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:26.397506 (+ 554us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:26.397968 (+ 462us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:26.398485 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:26.400500 (+ 2015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:26.401905 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:26.402945 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:26.403113 (+ 168us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:26.404334 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:26.404344 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:26.404361 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:26.405095 (+ 734us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:26.405222 (+ 127us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:26.405258 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:26.405413 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:26.405760 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 15:01:26.405929 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":347,"threads_started":1}
I20260808 15:01:26.407382 14686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1: Bootstrap starting.
I20260808 15:01:26.410720 14686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:26.410838 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:26.411801 14686 log.cc:824] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:26.414606 14686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1: No bootstrap required, opened a new log
I20260808 15:01:26.421447 14690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:26.415225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47645 (local address 127.0.0.1:42641)
0808 15:01:26.415375 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:26.415398 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:26.415818 (+ 420us) server_negotiation.cc:407] Connection header received
0808 15:01:26.416029 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:26.416032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:26.416089 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:26.416190 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:26.416673 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:26.417580 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:26.418892 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:26.419369 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:26.419508 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:26.420673 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:26.420678 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:26.420682 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:26.420699 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:26.420740 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:26.420755 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:26.420895 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:26.421076 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 15:01:26.421138 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 15:01:26.423097 14686 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f48a9d4e53f4b07bc769a4aa68daba1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42641 } }
I20260808 15:01:26.423537 14686 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:26.423652 14686 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f48a9d4e53f4b07bc769a4aa68daba1, State: Initialized, Role: FOLLOWER
I20260808 15:01:26.424209 14686 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f48a9d4e53f4b07bc769a4aa68daba1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42641 } }
I20260808 15:01:26.424451 14686 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:26.424608 14686 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:26.424798 14686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:26.427496 14686 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f48a9d4e53f4b07bc769a4aa68daba1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42641 } }
I20260808 15:01:26.427994 14686 leader_election.cc:302] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f48a9d4e53f4b07bc769a4aa68daba1; no voters:
I20260808 15:01:26.428587 14686 leader_election.cc:288] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:26.428709 14710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:26.429512 14710 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [term 1 LEADER]: Becoming Leader. State: Replica: 3f48a9d4e53f4b07bc769a4aa68daba1, State: Running, Role: LEADER
I20260808 15:01:26.430050 14710 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f48a9d4e53f4b07bc769a4aa68daba1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42641 } }
I20260808 15:01:26.430823 14686 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:26.433342 14713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f48a9d4e53f4b07bc769a4aa68daba1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f48a9d4e53f4b07bc769a4aa68daba1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42641 } } }
I20260808 15:01:26.433727 14713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:26.434166 14714 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f48a9d4e53f4b07bc769a4aa68daba1. Latest consensus state: current_term: 1 leader_uuid: "3f48a9d4e53f4b07bc769a4aa68daba1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f48a9d4e53f4b07bc769a4aa68daba1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42641 } } }
I20260808 15:01:26.434685 14714 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:26.435497 14719 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:26.442207 14719 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:26.450201 14719 catalog_manager.cc:1347] Generated new cluster ID: 00195faf6310442795c88fd3c9e1869f
I20260808 15:01:26.450304 14719 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:26.487202 14719 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:26.488545 14719 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:26.496932 14719 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f48a9d4e53f4b07bc769a4aa68daba1: Generated new TSK 0
I20260808 15:01:26.497725 14719 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:26.505074 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 14562
W20260808 15:01:26.507380 14676 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53513
W20260808 15:01:26.508085 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 14562: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 15:01:26.508280 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 14562
W20260808 15:01:26.534049 14535 connection.cc:535] client connection to 127.0.0.1:42641 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42641): Connection reset by peer (error 104)
2026-08-08T15:01:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2262 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:26 dist-test-slave-z8x9 krb5kdc[14741](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:26 dist-test-slave-z8x9 krb5kdc[14741](info): set up 2 sockets
Aug 08 15:01:26 dist-test-slave-z8x9 krb5kdc[14741](info): commencing operation
krb5kdc: starting...
W20260808 15:01:27.870483 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.318s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:28 dist-test-slave-z8x9 krb5kdc[14741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:01:28.191828 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45131
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:28.533823 14766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:28.534117 14766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:28.534211 14766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:28.541409 14766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:28.541530 14766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:28.541577 14766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:28.541640 14766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:28.541685 14766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:28.551425 14766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45131
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:28.552794 14766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:28.554051 14766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:28.565649 14787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:28.565753 14777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:28.565774 14776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:28.566720 14766 server_base.cc:1034] running on GCE node
I20260808 15:01:28.567488 14766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:28.568825 14766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:28.570061 14766 hybrid_clock.cc:648] HybridClock initialized: now 1786201288570017 us; error 38 us; skew 500 ppm
I20260808 15:01:28.570420 14766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:28 dist-test-slave-z8x9 krb5kdc[14741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201288, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:28.573580 14766 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:01:28.575076 14766 webserver.cc:460] Webserver started at http://127.0.0.1:39495/ using document root <none> and password file <none>
I20260808 15:01:28.575924 14766 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:28.576071 14766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:28.576468 14766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:28.579485 14766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "068fc17320b542cab16e6fb1d8d4a448"
format_stamp: "Formatted at 2026-08-08 15:01:28 on dist-test-slave-z8x9"
server_key: "2aadad8c312624f65f994d67d5f87be0"
server_key_iv: "5a7e5c83eabbeea148ee7cb1be892c72"
server_key_version: "encryptionkey@0"
I20260808 15:01:28.580252 14766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "068fc17320b542cab16e6fb1d8d4a448"
format_stamp: "Formatted at 2026-08-08 15:01:28 on dist-test-slave-z8x9"
server_key: "2aadad8c312624f65f994d67d5f87be0"
server_key_iv: "5a7e5c83eabbeea148ee7cb1be892c72"
server_key_version: "encryptionkey@0"
I20260808 15:01:28.585489 14766 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 15:01:28.588925 14801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:28.590255 14766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:01:28.590459 14766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "068fc17320b542cab16e6fb1d8d4a448"
format_stamp: "Formatted at 2026-08-08 15:01:28 on dist-test-slave-z8x9"
server_key: "2aadad8c312624f65f994d67d5f87be0"
server_key_iv: "5a7e5c83eabbeea148ee7cb1be892c72"
server_key_version: "encryptionkey@0"
I20260808 15:01:28.590664 14766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:28.596451 14766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:28.601133 14766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:28.601508 14766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:28.621794 14766 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45131
I20260808 15:01:28.621879 14912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45131 every 8 connection(s)
I20260808 15:01:28.623162 14766 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:28.625366 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 14766
I20260808 15:01:28.625548 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:28.626021 12582 external_mini_cluster.cc:1428] Setting key 008787a61b0c0edc75b3674dffd251ca
I20260808 15:01:28.627267 14914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:28.634495 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:28.627792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49471 (local address 127.0.0.1:45131)
0808 15:01:28.628664 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:28.628679 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:28.628734 (+ 55us) server_negotiation.cc:407] Connection header received
0808 15:01:28.630627 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:28.630654 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:28.631095 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:28.631543 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:28.632532 (+ 989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:28.632541 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:28.632559 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:28.632576 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:28.632672 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:28.632699 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:28.632913 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:28.633071 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 15:01:28.633301 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":351,"threads_started":1}
I20260808 15:01:28.638106 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:28.640865 14914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448: Bootstrap starting.
I20260808 15:01:28.644377 14914 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:28.644956 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:28.642509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52811 (local address 127.0.0.1:45131)
0808 15:01:28.642684 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:28.642690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:28.642951 (+ 261us) server_negotiation.cc:407] Connection header received
0808 15:01:28.643072 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:28.643080 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:28.643138 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:28.643246 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:28.644191 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:28.644200 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:28.644205 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:28.644225 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:28.644281 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:28.644302 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:28.644435 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:28.644569 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 15:01:28.644627 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:01:28.645727 14914 log.cc:824] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:28.648348 14914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448: No bootstrap required, opened a new log
I20260808 15:01:28.655603 14914 raft_consensus.cc:348] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "068fc17320b542cab16e6fb1d8d4a448" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45131 } }
I20260808 15:01:28.656039 14914 raft_consensus.cc:374] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:28.656168 14914 raft_consensus.cc:729] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 068fc17320b542cab16e6fb1d8d4a448, State: Initialized, Role: FOLLOWER
I20260808 15:01:28.656746 14914 consensus_queue.cc:260] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "068fc17320b542cab16e6fb1d8d4a448" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45131 } }
I20260808 15:01:28.657032 14914 raft_consensus.cc:388] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:28.657240 14914 raft_consensus.cc:482] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:28.657429 14914 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:28.659576 14914 raft_consensus.cc:504] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "068fc17320b542cab16e6fb1d8d4a448" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45131 } }
I20260808 15:01:28.660188 14914 leader_election.cc:302] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 068fc17320b542cab16e6fb1d8d4a448; no voters:
I20260808 15:01:28.660988 14914 leader_election.cc:288] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:28.661139 14932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:28.661953 14932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [term 1 LEADER]: Becoming Leader. State: Replica: 068fc17320b542cab16e6fb1d8d4a448, State: Running, Role: LEADER
I20260808 15:01:28.662550 14932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "068fc17320b542cab16e6fb1d8d4a448" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45131 } }
I20260808 15:01:28.665923 14933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 068fc17320b542cab16e6fb1d8d4a448. Latest consensus state: current_term: 1 leader_uuid: "068fc17320b542cab16e6fb1d8d4a448" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "068fc17320b542cab16e6fb1d8d4a448" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45131 } } }
I20260808 15:01:28.666352 14933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:28.666720 14936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "068fc17320b542cab16e6fb1d8d4a448" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "068fc17320b542cab16e6fb1d8d4a448" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45131 } } }
I20260808 15:01:28.667001 14914 sys_catalog.cc:564] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:28.667016 14936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:28.671649 14941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:28.678890 14941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:28.687068 14941 catalog_manager.cc:1347] Generated new cluster ID: e668d04ee6ca440fa73ac93c26411ea2
I20260808 15:01:28.687197 14941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:28.705538 14941 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:28.706028 14941 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:28.714171 14941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 068fc17320b542cab16e6fb1d8d4a448: Generated new TSK 0
I20260808 15:01:28.714951 14941 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:28.729391 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 14766
W20260808 15:01:28.730494 14905 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49471
W20260808 15:01:28.731268 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 14766: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 15:01:28.731427 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 14766
2026-08-08T15:01:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2224 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:28 dist-test-slave-z8x9 krb5kdc[14975](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:28 dist-test-slave-z8x9 krb5kdc[14975](info): set up 2 sockets
Aug 08 15:01:28 dist-test-slave-z8x9 krb5kdc[14975](info): commencing operation
krb5kdc: starting...
W20260808 15:01:30.090293 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.002s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:30 dist-test-slave-z8x9 krb5kdc[14975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:01:30.417992 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38875
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:30.768951 14999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:30.769351 14999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:30.769518 14999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:30.776667 14999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:30.776805 14999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:30.776896 14999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:30.777016 14999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:30.777107 14999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:30.787395 14999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:30.788636 14999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:30.789994 14999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:30.801744 15009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:30.801698 15005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:30.801942 15013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:30.802870 14999 server_base.cc:1034] running on GCE node
I20260808 15:01:30.803721 14999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:30.805087 14999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:30.806375 14999 hybrid_clock.cc:648] HybridClock initialized: now 1786201290806325 us; error 43 us; skew 500 ppm
I20260808 15:01:30.806728 14999 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:30 dist-test-slave-z8x9 krb5kdc[14975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201290, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:30.809917 14999 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:01:30.811326 14999 webserver.cc:460] Webserver started at http://127.0.0.1:42567/ using document root <none> and password file <none>
I20260808 15:01:30.812000 14999 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:30.812148 14999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:30.812461 14999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:30.815526 14999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "cdbf2a715fa8473cb96c7ef0286bc3f7"
format_stamp: "Formatted at 2026-08-08 15:01:30 on dist-test-slave-z8x9"
server_key: "fc93b7f7ad80cb5f0ab1b76fc1632928"
server_key_iv: "5101976ff06350f986318d08f90dd511"
server_key_version: "encryptionkey@0"
I20260808 15:01:30.816304 14999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "cdbf2a715fa8473cb96c7ef0286bc3f7"
format_stamp: "Formatted at 2026-08-08 15:01:30 on dist-test-slave-z8x9"
server_key: "fc93b7f7ad80cb5f0ab1b76fc1632928"
server_key_iv: "5101976ff06350f986318d08f90dd511"
server_key_version: "encryptionkey@0"
I20260808 15:01:30.821393 14999 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260808 15:01:30.824769 15028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:30.826113 14999 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:01:30.826316 14999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "cdbf2a715fa8473cb96c7ef0286bc3f7"
format_stamp: "Formatted at 2026-08-08 15:01:30 on dist-test-slave-z8x9"
server_key: "fc93b7f7ad80cb5f0ab1b76fc1632928"
server_key_iv: "5101976ff06350f986318d08f90dd511"
server_key_version: "encryptionkey@0"
I20260808 15:01:30.826510 14999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:30.839401 14999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:30.843225 14999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:30.843509 14999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:30.861752 14999 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38875
I20260808 15:01:30.861794 15118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38875 every 8 connection(s)
I20260808 15:01:30.863085 14999 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:30.866676 15120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:30.869055 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 14999
I20260808 15:01:30.869292 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:30.869725 12582 external_mini_cluster.cc:1428] Setting key d6b99ddd87aae175209b9d45eb490302
I20260808 15:01:30.878571 15120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7: Bootstrap starting.
I20260808 15:01:30.882277 15120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:30.883605 15120 log.cc:824] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:01:30 dist-test-slave-z8x9 krb5kdc[14975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 15:01:30.886907 15120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7: No bootstrap required, opened a new log
I20260808 15:01:30.893630 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:30.871433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59761 (local address 127.0.0.1:38875)
0808 15:01:30.872262 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:30.872273 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:30.872312 (+ 39us) server_negotiation.cc:407] Connection header received
0808 15:01:30.873945 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:30.873967 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:30.874329 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:30.874650 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:30.876515 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:30.877926 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:30.879739 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:30.880450 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:30.880591 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:30.885977 (+ 5386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:30.885985 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:30.885998 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:30.886032 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:30.889445 (+ 3413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:30.890299 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:30.890304 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:30.890310 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:30.890476 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:30.890916 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:30.890919 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:30.890921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:30.891426 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:30.891646 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:30.892127 (+ 481us) server_negotiation.cc:299] Negotiation successful
0808 15:01:30.892529 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":399,"threads_started":1}
I20260808 15:01:30.896267 15120 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdbf2a715fa8473cb96c7ef0286bc3f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38875 } }
I20260808 15:01:30.896636 15120 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:30.896754 15120 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdbf2a715fa8473cb96c7ef0286bc3f7, State: Initialized, Role: FOLLOWER
I20260808 15:01:30.897526 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:30.897426 15120 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdbf2a715fa8473cb96c7ef0286bc3f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38875 } }
I20260808 15:01:30.897677 15120 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:30.897823 15120 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:30.897984 15120 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:30.900135 15120 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdbf2a715fa8473cb96c7ef0286bc3f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38875 } }
I20260808 15:01:30.900754 15120 leader_election.cc:302] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdbf2a715fa8473cb96c7ef0286bc3f7; no voters:
I20260808 15:01:30.901443 15120 leader_election.cc:288] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:30.901547 15138 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:30.903102 15138 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [term 1 LEADER]: Becoming Leader. State: Replica: cdbf2a715fa8473cb96c7ef0286bc3f7, State: Running, Role: LEADER
I20260808 15:01:30.903825 15120 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:30.903744 15138 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdbf2a715fa8473cb96c7ef0286bc3f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38875 } }
I20260808 15:01:30.911974 15140 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdbf2a715fa8473cb96c7ef0286bc3f7. Latest consensus state: current_term: 1 leader_uuid: "cdbf2a715fa8473cb96c7ef0286bc3f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdbf2a715fa8473cb96c7ef0286bc3f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38875 } } }
I20260808 15:01:30.912552 15140 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:30.912724 15139 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdbf2a715fa8473cb96c7ef0286bc3f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdbf2a715fa8473cb96c7ef0286bc3f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38875 } } }
I20260808 15:01:30.913228 15139 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:30.921288 15151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:30.929944 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:30.902489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45103 (local address 127.0.0.1:38875)
0808 15:01:30.902693 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:30.902699 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:30.909755 (+ 7056us) server_negotiation.cc:407] Connection header received
0808 15:01:30.909959 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:30.909966 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:30.910037 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:30.910117 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:30.912497 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:30.913836 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:30.915726 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:30.916708 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:30.916836 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:30.920341 (+ 3505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:30.920347 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:30.920352 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:30.920402 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:30.924825 (+ 4423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:30.925979 (+ 1154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:30.925987 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:30.925993 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:30.926170 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:30.926791 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:30.926799 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:30.926805 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:30.927398 (+ 593us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:30.928951 (+ 1553us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:30.929156 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 15:01:30.929474 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 15:01:30.935038 15151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:30.944190 15151 catalog_manager.cc:1347] Generated new cluster ID: a39a75cb1d1847519a44300a256577e1
I20260808 15:01:30.944310 15151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:30.989526 15151 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:30.990832 15151 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:30.999696 15151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdbf2a715fa8473cb96c7ef0286bc3f7: Generated new TSK 0
I20260808 15:01:31.000660 15151 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:31.015995 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 14999
I20260808 15:01:31.017453 15114 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:31.112178 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 14999
2026-08-08T15:01:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2380 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:31 dist-test-slave-z8x9 krb5kdc[15171](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:31 dist-test-slave-z8x9 krb5kdc[15171](info): set up 2 sockets
Aug 08 15:01:31 dist-test-slave-z8x9 krb5kdc[15171](info): commencing operation
krb5kdc: starting...
W20260808 15:01:32.479583 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:32 dist-test-slave-z8x9 krb5kdc[15171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:01:32.808983 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38773
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:33.171368 15186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:33.171655 15186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:33.171749 15186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:33.179032 15186 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:33.179160 15186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:33.179225 15186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:33.179282 15186 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:33.179329 15186 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:33.189251 15186 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38773
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:33.190532 15186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:33.191810 15186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:33.203943 15191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:33.203917 15195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:33.203902 15193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:33.204756 15186 server_base.cc:1034] running on GCE node
I20260808 15:01:33.205685 15186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:33.207113 15186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:33.208356 15186 hybrid_clock.cc:648] HybridClock initialized: now 1786201293208314 us; error 26 us; skew 500 ppm
I20260808 15:01:33.208741 15186 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:33 dist-test-slave-z8x9 krb5kdc[15171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201293, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:33.212040 15186 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:01:33.213610 15186 webserver.cc:460] Webserver started at http://127.0.0.1:41853/ using document root <none> and password file <none>
I20260808 15:01:33.214249 15186 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:33.214356 15186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:33.214607 15186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:33.217666 15186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "f268e3b7ab2f40ddaf3f93fd923c20e2"
format_stamp: "Formatted at 2026-08-08 15:01:33 on dist-test-slave-z8x9"
server_key: "b9e179018119774651bb58a28f6cda3c"
server_key_iv: "63752eec294ca0868692375ddb61037f"
server_key_version: "encryptionkey@0"
I20260808 15:01:33.218385 15186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "f268e3b7ab2f40ddaf3f93fd923c20e2"
format_stamp: "Formatted at 2026-08-08 15:01:33 on dist-test-slave-z8x9"
server_key: "b9e179018119774651bb58a28f6cda3c"
server_key_iv: "63752eec294ca0868692375ddb61037f"
server_key_version: "encryptionkey@0"
I20260808 15:01:33.224720 15186 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 15:01:33.228114 15213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:33.229548 15186 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 15:01:33.229745 15186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "f268e3b7ab2f40ddaf3f93fd923c20e2"
format_stamp: "Formatted at 2026-08-08 15:01:33 on dist-test-slave-z8x9"
server_key: "b9e179018119774651bb58a28f6cda3c"
server_key_iv: "63752eec294ca0868692375ddb61037f"
server_key_version: "encryptionkey@0"
I20260808 15:01:33.229947 15186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:33.265051 15186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:33.269217 15186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:33.269526 15186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:33.288336 15186 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38773
I20260808 15:01:33.288378 15315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38773 every 8 connection(s)
I20260808 15:01:33.289721 15186 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:33.292317 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 15186
I20260808 15:01:33.292515 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:33.292980 12582 external_mini_cluster.cc:1428] Setting key 93cb532bab335d6c7b917288a546f016
I20260808 15:01:33.293535 15317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:33.305996 15317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2: Bootstrap starting.
I20260808 15:01:33.306514 15320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:33.294789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55047 (local address 127.0.0.1:38773)
0808 15:01:33.295571 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:33.295583 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:33.295623 (+ 40us) server_negotiation.cc:407] Connection header received
0808 15:01:33.298124 (+ 2501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:33.298146 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:33.298539 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:33.298922 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:33.299469 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:33.300745 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:33.302135 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:33.302806 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:33.303060 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:33.304279 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:33.304286 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:33.304300 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:33.304805 (+ 505us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:33.304880 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:33.304904 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:33.305034 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:33.305309 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 15:01:33.305556 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":355,"threads_started":1}
I20260808 15:01:33.309605 15317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:33.310251 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:33.310745 15317 log.cc:824] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:33.313624 15317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2: No bootstrap required, opened a new log
I20260808 15:01:33.321338 15320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:33.315000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59991 (local address 127.0.0.1:38773)
0808 15:01:33.315169 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:33.315176 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:33.315608 (+ 432us) server_negotiation.cc:407] Connection header received
0808 15:01:33.315820 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:33.315824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:33.315883 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:33.315991 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:33.316505 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:33.317359 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:33.318673 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:33.319148 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:33.319304 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:33.320446 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:33.320471 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:33.320474 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:33.320490 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:33.320635 (+ 145us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:33.320662 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:33.320757 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:33.320915 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 15:01:33.321000 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 15:01:33.321794 15317 raft_consensus.cc:348] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f268e3b7ab2f40ddaf3f93fd923c20e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38773 } }
I20260808 15:01:33.322176 15317 raft_consensus.cc:374] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:33.322302 15317 raft_consensus.cc:729] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f268e3b7ab2f40ddaf3f93fd923c20e2, State: Initialized, Role: FOLLOWER
I20260808 15:01:33.322897 15317 consensus_queue.cc:260] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f268e3b7ab2f40ddaf3f93fd923c20e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38773 } }
I20260808 15:01:33.323153 15317 raft_consensus.cc:388] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:33.323292 15317 raft_consensus.cc:482] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:33.323467 15317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:33.326015 15317 raft_consensus.cc:504] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f268e3b7ab2f40ddaf3f93fd923c20e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38773 } }
I20260808 15:01:33.326504 15317 leader_election.cc:302] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f268e3b7ab2f40ddaf3f93fd923c20e2; no voters:
I20260808 15:01:33.327085 15317 leader_election.cc:288] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:33.327242 15332 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:33.328058 15332 raft_consensus.cc:686] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [term 1 LEADER]: Becoming Leader. State: Replica: f268e3b7ab2f40ddaf3f93fd923c20e2, State: Running, Role: LEADER
I20260808 15:01:33.328626 15332 consensus_queue.cc:237] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f268e3b7ab2f40ddaf3f93fd923c20e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38773 } }
I20260808 15:01:33.329505 15317 sys_catalog.cc:564] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:33.331667 15333 sys_catalog.cc:455] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f268e3b7ab2f40ddaf3f93fd923c20e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f268e3b7ab2f40ddaf3f93fd923c20e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38773 } } }
I20260808 15:01:33.331687 15334 sys_catalog.cc:455] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f268e3b7ab2f40ddaf3f93fd923c20e2. Latest consensus state: current_term: 1 leader_uuid: "f268e3b7ab2f40ddaf3f93fd923c20e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f268e3b7ab2f40ddaf3f93fd923c20e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38773 } } }
I20260808 15:01:33.332168 15334 sys_catalog.cc:458] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:33.333691 15338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:33.333709 15333 sys_catalog.cc:458] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:33.338564 15338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:33.348591 15338 catalog_manager.cc:1347] Generated new cluster ID: bfef1881da1745dda75ca070ff36b3f8
I20260808 15:01:33.348716 15338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:33.364877 15338 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:33.366155 15338 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:33.378075 15338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f268e3b7ab2f40ddaf3f93fd923c20e2: Generated new TSK 0
I20260808 15:01:33.378888 15338 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:33.388221 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15186
W20260808 15:01:33.389583 15309 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55047
W20260808 15:01:33.390286 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15186: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 15:01:33.390442 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 15186
2026-08-08T15:01:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2273 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:33 dist-test-slave-z8x9 krb5kdc[15366](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:33 dist-test-slave-z8x9 krb5kdc[15366](info): set up 2 sockets
Aug 08 15:01:33 dist-test-slave-z8x9 krb5kdc[15366](info): commencing operation
krb5kdc: starting...
W20260808 15:01:34.743360 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:34 dist-test-slave-z8x9 krb5kdc[15366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:01:35.071784 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43909
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43909
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:35.444375 15393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:35.444769 15393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:35.444957 15393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:35.460045 15393 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:35.460211 15393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:35.460309 15393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:35.460427 15393 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:35.460510 15393 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:35.476694 15393 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43909
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:35.478096 15393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:35.479377 15393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:35.491743 15405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:35.491823 15409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:35.491863 15400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:35.492803 15393 server_base.cc:1034] running on GCE node
I20260808 15:01:35.493829 15393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:35.495399 15393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:35.496675 15393 hybrid_clock.cc:648] HybridClock initialized: now 1786201295496623 us; error 47 us; skew 500 ppm
I20260808 15:01:35.497042 15393 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:35 dist-test-slave-z8x9 krb5kdc[15366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201295, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:35.500325 15393 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:01:35.502024 15393 webserver.cc:460] Webserver started at http://127.0.0.1:41275/ using document root <none> and password file <none>
I20260808 15:01:35.502701 15393 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:35.502831 15393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:35.503159 15393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:35.506151 15393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "7a871b9972c04b6da88c637bf9dcf9fa"
format_stamp: "Formatted at 2026-08-08 15:01:35 on dist-test-slave-z8x9"
server_key: "1a7072d58e4d775b909f47a33fbeef1c"
server_key_iv: "5173222554fa2621cca4a175166a67a1"
server_key_version: "encryptionkey@0"
I20260808 15:01:35.506915 15393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "7a871b9972c04b6da88c637bf9dcf9fa"
format_stamp: "Formatted at 2026-08-08 15:01:35 on dist-test-slave-z8x9"
server_key: "1a7072d58e4d775b909f47a33fbeef1c"
server_key_iv: "5173222554fa2621cca4a175166a67a1"
server_key_version: "encryptionkey@0"
I20260808 15:01:35.512019 15393 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260808 15:01:35.515532 15417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:35.516865 15393 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 15:01:35.517042 15393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "7a871b9972c04b6da88c637bf9dcf9fa"
format_stamp: "Formatted at 2026-08-08 15:01:35 on dist-test-slave-z8x9"
server_key: "1a7072d58e4d775b909f47a33fbeef1c"
server_key_iv: "5173222554fa2621cca4a175166a67a1"
server_key_version: "encryptionkey@0"
I20260808 15:01:35.517315 15393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:35.523248 15393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:35.527683 15393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:35.527992 15393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:35.548828 15393 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43909
I20260808 15:01:35.548856 15498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43909 every 8 connection(s)
I20260808 15:01:35.550391 15393 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:35.553356 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 15393
I20260808 15:01:35.553546 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:35.553958 12582 external_mini_cluster.cc:1428] Setting key 305a58ffa4675d71bab56d891594c536
I20260808 15:01:35.555570 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:35.564293 15503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:35.555801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34461 (local address 127.0.0.1:43909)
0808 15:01:35.556810 (+ 1009us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:35.556830 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:35.556891 (+ 61us) server_negotiation.cc:407] Connection header received
0808 15:01:35.559758 (+ 2867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:35.559791 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:35.560324 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:35.560845 (+ 521us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:35.562008 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:35.562019 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:35.562039 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:35.562063 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:35.562166 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:35.562203 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:35.562471 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:35.562619 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 15:01:35.562837 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":447,"threads_started":1}
I20260808 15:01:35.568763 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:35.570107 15499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa: Bootstrap starting.
I20260808 15:01:35.574163 15499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:35.575599 15499 log.cc:824] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:35.577749 15503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:35.574473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32801 (local address 127.0.0.1:43909)
0808 15:01:35.574692 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:35.574699 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:35.575281 (+ 582us) server_negotiation.cc:407] Connection header received
0808 15:01:35.575486 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:35.575494 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:35.575569 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:35.575697 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:35.576865 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:35.576873 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:35.576879 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:35.576908 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:35.576999 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:35.577024 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:35.577194 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:35.577340 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 15:01:35.577411 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:01:35.579134 15499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa: No bootstrap required, opened a new log
I20260808 15:01:35.586684 15499 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a871b9972c04b6da88c637bf9dcf9fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43909 } }
I20260808 15:01:35.587076 15499 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:35.587184 15499 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a871b9972c04b6da88c637bf9dcf9fa, State: Initialized, Role: FOLLOWER
I20260808 15:01:35.587801 15499 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a871b9972c04b6da88c637bf9dcf9fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43909 } }
I20260808 15:01:35.588048 15499 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:35.588187 15499 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:35.588373 15499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:35.590914 15499 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a871b9972c04b6da88c637bf9dcf9fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43909 } }
I20260808 15:01:35.591392 15499 leader_election.cc:302] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a871b9972c04b6da88c637bf9dcf9fa; no voters:
I20260808 15:01:35.591995 15499 leader_election.cc:288] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:35.592167 15525 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:35.592947 15525 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [term 1 LEADER]: Becoming Leader. State: Replica: 7a871b9972c04b6da88c637bf9dcf9fa, State: Running, Role: LEADER
I20260808 15:01:35.593670 15525 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a871b9972c04b6da88c637bf9dcf9fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43909 } }
I20260808 15:01:35.594165 15499 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:35.608593 15528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a871b9972c04b6da88c637bf9dcf9fa. Latest consensus state: current_term: 1 leader_uuid: "7a871b9972c04b6da88c637bf9dcf9fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a871b9972c04b6da88c637bf9dcf9fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43909 } } }
I20260808 15:01:35.609114 15528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:35.609779 15527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a871b9972c04b6da88c637bf9dcf9fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a871b9972c04b6da88c637bf9dcf9fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43909 } } }
I20260808 15:01:35.610128 15527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa [sys.catalog]: This master's current role is: LEADER
W20260808 15:01:35.623329 15549 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:01:35.623481 15549 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:01:35.623675 15550 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:35.625903 15550 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:35.635145 15550 catalog_manager.cc:1347] Generated new cluster ID: 57bb06ce0d0a46388173248a9f28a889
I20260808 15:01:35.635258 15550 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:35.648166 15550 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:35.648698 15550 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:35.659036 15550 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a871b9972c04b6da88c637bf9dcf9fa: Generated new TSK 0
I20260808 15:01:35.660120 15550 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:35.681950 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15393
W20260808 15:01:35.683040 15492 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34461
W20260808 15:01:35.683730 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15393: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 15:01:35.683884 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 15393
2026-08-08T15:01:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2301 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:35 dist-test-slave-z8x9 krb5kdc[15568](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:35 dist-test-slave-z8x9 krb5kdc[15568](info): set up 2 sockets
Aug 08 15:01:35 dist-test-slave-z8x9 krb5kdc[15568](info): commencing operation
krb5kdc: starting...
W20260808 15:01:37.063217 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.005s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:37 dist-test-slave-z8x9 krb5kdc[15568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:01:37.396934 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45611
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:37.739857 15588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:37.740195 15588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:37.740338 15588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:37.747723 15588 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:37.747862 15588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:37.747951 15588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:37.748071 15588 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:37.748167 15588 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:37.758407 15588 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45611
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:37.759795 15588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:37.761200 15588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:37.773260 15594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:37.773454 15595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:37.773393 15597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:37.774660 15588 server_base.cc:1034] running on GCE node
I20260808 15:01:37.775456 15588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:37.776876 15588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:37.778082 15588 hybrid_clock.cc:648] HybridClock initialized: now 1786201297778038 us; error 35 us; skew 500 ppm
I20260808 15:01:37.778465 15588 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:37 dist-test-slave-z8x9 krb5kdc[15568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201297, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:37.781737 15588 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:01:37.783318 15588 webserver.cc:460] Webserver started at http://127.0.0.1:40371/ using document root <none> and password file <none>
I20260808 15:01:37.784006 15588 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:37.784147 15588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:37.784483 15588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:37.787561 15588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "ff5bf2a63a5c4852bd5f3fc0b9b37e64"
format_stamp: "Formatted at 2026-08-08 15:01:37 on dist-test-slave-z8x9"
server_key: "d7471e9febedde2e0b13cad430dedb64"
server_key_iv: "8c1503f6136749cd36b194e284ec0621"
server_key_version: "encryptionkey@0"
I20260808 15:01:37.788379 15588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "ff5bf2a63a5c4852bd5f3fc0b9b37e64"
format_stamp: "Formatted at 2026-08-08 15:01:37 on dist-test-slave-z8x9"
server_key: "d7471e9febedde2e0b13cad430dedb64"
server_key_iv: "8c1503f6136749cd36b194e284ec0621"
server_key_version: "encryptionkey@0"
I20260808 15:01:37.793855 15588 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 15:01:37.797457 15607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:37.798770 15588 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 15:01:37.799057 15588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "ff5bf2a63a5c4852bd5f3fc0b9b37e64"
format_stamp: "Formatted at 2026-08-08 15:01:37 on dist-test-slave-z8x9"
server_key: "d7471e9febedde2e0b13cad430dedb64"
server_key_iv: "8c1503f6136749cd36b194e284ec0621"
server_key_version: "encryptionkey@0"
I20260808 15:01:37.799269 15588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:37.811010 15588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:37.815088 15588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:37.815373 15588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:37.834512 15588 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45611
I20260808 15:01:37.834549 15691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45611 every 8 connection(s)
I20260808 15:01:37.835965 15588 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:37.839673 15693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:37.840384 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 15588
I20260808 15:01:37.840582 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:37.841041 12582 external_mini_cluster.cc:1428] Setting key fd6d34b5c1c7f4042139e0fe1af4f14e
I20260808 15:01:37.853742 15693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64: Bootstrap starting.
Aug 08 15:01:37 dist-test-slave-z8x9 krb5kdc[15568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 15:01:37.857623 15693 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:37.858736 15693 log.cc:824] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:37.861744 15693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64: No bootstrap required, opened a new log
I20260808 15:01:37.865511 15699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:37.843127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:41187 (local address 127.0.0.1:45611)
0808 15:01:37.843948 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:37.843963 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:37.844006 (+ 43us) server_negotiation.cc:407] Connection header received
0808 15:01:37.845732 (+ 1726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:37.845754 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:37.846154 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:37.846479 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:37.848295 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:37.849690 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:37.851591 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:37.852251 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:37.852377 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:37.857623 (+ 5246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:37.857631 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:37.857646 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:37.857721 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:37.861029 (+ 3308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:37.861971 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:37.861978 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:37.861984 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:37.862158 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:37.862680 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:37.862689 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:37.862691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:37.863201 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:37.863577 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:37.864100 (+ 523us) server_negotiation.cc:299] Negotiation successful
0808 15:01:37.864435 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":382,"threads_started":1}
I20260808 15:01:37.869597 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:37.870558 15693 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff5bf2a63a5c4852bd5f3fc0b9b37e64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45611 } }
I20260808 15:01:37.870932 15693 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:37.871039 15693 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff5bf2a63a5c4852bd5f3fc0b9b37e64, State: Initialized, Role: FOLLOWER
I20260808 15:01:37.871624 15693 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff5bf2a63a5c4852bd5f3fc0b9b37e64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45611 } }
I20260808 15:01:37.871881 15693 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:37.872022 15693 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:37.872215 15693 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:37.875257 15693 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff5bf2a63a5c4852bd5f3fc0b9b37e64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45611 } }
I20260808 15:01:37.875757 15693 leader_election.cc:302] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff5bf2a63a5c4852bd5f3fc0b9b37e64; no voters:
I20260808 15:01:37.876421 15693 leader_election.cc:288] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:37.876555 15710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:37.877907 15710 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [term 1 LEADER]: Becoming Leader. State: Replica: ff5bf2a63a5c4852bd5f3fc0b9b37e64, State: Running, Role: LEADER
I20260808 15:01:37.878573 15710 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff5bf2a63a5c4852bd5f3fc0b9b37e64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45611 } }
I20260808 15:01:37.878964 15693 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:37.882192 15712 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff5bf2a63a5c4852bd5f3fc0b9b37e64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff5bf2a63a5c4852bd5f3fc0b9b37e64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45611 } } }
I20260808 15:01:37.882625 15712 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:37.888772 15714 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff5bf2a63a5c4852bd5f3fc0b9b37e64. Latest consensus state: current_term: 1 leader_uuid: "ff5bf2a63a5c4852bd5f3fc0b9b37e64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff5bf2a63a5c4852bd5f3fc0b9b37e64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45611 } } }
I20260808 15:01:37.889107 15714 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:37.894892 15699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:37.874306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:51577 (local address 127.0.0.1:45611)
0808 15:01:37.874458 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:37.874463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:37.875000 (+ 537us) server_negotiation.cc:407] Connection header received
0808 15:01:37.875190 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:37.875196 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:37.875275 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:37.875379 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:37.877216 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:37.878324 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:37.879792 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:37.880529 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:37.880847 (+ 318us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:37.884586 (+ 3739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:37.884596 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:37.884605 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:37.884658 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:37.889467 (+ 4809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:37.890797 (+ 1330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:37.890807 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:37.890813 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:37.891006 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:37.891719 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:37.891728 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:37.891733 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:37.892269 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:37.892629 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:37.894145 (+ 1516us) server_negotiation.cc:299] Negotiation successful
0808 15:01:37.894465 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:01:37.895653 15724 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:37.901578 15724 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:37.911069 15724 catalog_manager.cc:1347] Generated new cluster ID: a9f3a916c15448e6a763f032d69d1f81
I20260808 15:01:37.911208 15724 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:37.927775 15724 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:37.929147 15724 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:37.939919 15724 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff5bf2a63a5c4852bd5f3fc0b9b37e64: Generated new TSK 0
I20260808 15:01:37.940963 15724 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:37.950737 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15588
I20260808 15:01:37.952404 15687 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:38.044226 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 15588
W20260808 15:01:38.068463 15555 connection.cc:535] client connection to 127.0.0.1:45611 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45611): Connection reset by peer (error 104)
2026-08-08T15:01:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2354 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:38 dist-test-slave-z8x9 krb5kdc[15748](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:38 dist-test-slave-z8x9 krb5kdc[15748](info): set up 2 sockets
Aug 08 15:01:38 dist-test-slave-z8x9 krb5kdc[15748](info): commencing operation
krb5kdc: starting...
W20260808 15:01:39.412648 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.001s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:39 dist-test-slave-z8x9 krb5kdc[15748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:01:39.738555 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41117
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:40.079793 15767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:40.080086 15767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:40.080260 15767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:40.087522 15767 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:40.087630 15767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:40.087738 15767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:40.087843 15767 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:40.087921 15767 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:40.097783 15767 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:40.099179 15767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:40.100562 15767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:40.112572 15778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:40.112696 15776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:40.112823 15775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:40.113981 15767 server_base.cc:1034] running on GCE node
I20260808 15:01:40.114784 15767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:40.116250 15767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:40.117497 15767 hybrid_clock.cc:648] HybridClock initialized: now 1786201300117448 us; error 73 us; skew 500 ppm
I20260808 15:01:40.117867 15767 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:40 dist-test-slave-z8x9 krb5kdc[15748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201300, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:40.121237 15767 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:01:40.122767 15767 webserver.cc:460] Webserver started at http://127.0.0.1:35817/ using document root <none> and password file <none>
I20260808 15:01:40.123476 15767 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:40.123625 15767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:40.123941 15767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:40.126981 15767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "f656e75456c24d679b2e68ce679451c4"
format_stamp: "Formatted at 2026-08-08 15:01:40 on dist-test-slave-z8x9"
server_key: "ed03d28c156b9dc98910002616eff68f"
server_key_iv: "ad74200e89dad2742f5121ba96b1b1b6"
server_key_version: "encryptionkey@0"
I20260808 15:01:40.127750 15767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "f656e75456c24d679b2e68ce679451c4"
format_stamp: "Formatted at 2026-08-08 15:01:40 on dist-test-slave-z8x9"
server_key: "ed03d28c156b9dc98910002616eff68f"
server_key_iv: "ad74200e89dad2742f5121ba96b1b1b6"
server_key_version: "encryptionkey@0"
I20260808 15:01:40.132843 15767 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260808 15:01:40.136376 15789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:40.137781 15767 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 15:01:40.137959 15767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "f656e75456c24d679b2e68ce679451c4"
format_stamp: "Formatted at 2026-08-08 15:01:40 on dist-test-slave-z8x9"
server_key: "ed03d28c156b9dc98910002616eff68f"
server_key_iv: "ad74200e89dad2742f5121ba96b1b1b6"
server_key_version: "encryptionkey@0"
I20260808 15:01:40.138159 15767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:40.156399 15767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:40.160441 15767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:40.160737 15767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:40.180480 15767 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41117
I20260808 15:01:40.180500 15877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41117 every 8 connection(s)
I20260808 15:01:40.181978 15767 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:40.185734 15878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:40.190656 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 15767
I20260808 15:01:40.190856 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:40.191435 12582 external_mini_cluster.cc:1428] Setting key c729f8a63f41b7e3a33a2a0c3cc5dca5
I20260808 15:01:40.197548 15878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4: Bootstrap starting.
I20260808 15:01:40.200603 15878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:40.201781 15878 log.cc:824] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:40.205108 15878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4: No bootstrap required, opened a new log
I20260808 15:01:40.205366 15885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:40.193365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:53547 (local address 127.0.0.1:41117)
0808 15:01:40.194128 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:40.194141 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:40.194189 (+ 48us) server_negotiation.cc:407] Connection header received
0808 15:01:40.196146 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:40.196169 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:40.196566 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:40.196938 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:40.197554 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:40.198926 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:40.200283 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:40.201060 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:40.201306 (+ 246us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:40.202653 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:40.202664 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:40.202677 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:40.203315 (+ 638us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:40.203406 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:40.203439 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:40.203606 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:40.203886 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 15:01:40.204057 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":339,"threads_started":1}
I20260808 15:01:40.209256 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:40.213519 15878 raft_consensus.cc:348] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f656e75456c24d679b2e68ce679451c4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41117 } }
I20260808 15:01:40.214160 15878 raft_consensus.cc:374] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:40.214381 15878 raft_consensus.cc:729] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f656e75456c24d679b2e68ce679451c4, State: Initialized, Role: FOLLOWER
I20260808 15:01:40.215133 15878 consensus_queue.cc:260] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f656e75456c24d679b2e68ce679451c4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41117 } }
I20260808 15:01:40.215435 15878 raft_consensus.cc:388] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:40.215624 15878 raft_consensus.cc:482] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:40.215827 15878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:40.218354 15878 raft_consensus.cc:504] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f656e75456c24d679b2e68ce679451c4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41117 } }
I20260808 15:01:40.218938 15878 leader_election.cc:302] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f656e75456c24d679b2e68ce679451c4; no voters:
I20260808 15:01:40.219580 15878 leader_election.cc:288] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:40.219702 15896 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:40.221158 15885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:40.213947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:38211 (local address 127.0.0.1:41117)
0808 15:01:40.214135 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:40.214146 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:40.214534 (+ 388us) server_negotiation.cc:407] Connection header received
0808 15:01:40.214734 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:40.214739 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:40.214828 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:40.214929 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:40.215469 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:40.216431 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:40.217913 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:40.218401 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:40.218544 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:40.219909 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:40.219917 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:40.219924 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:40.219955 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:40.220071 (+ 116us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:40.220105 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:40.220666 (+ 561us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:40.220753 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 15:01:40.220805 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 15:01:40.221971 15896 raft_consensus.cc:686] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [term 1 LEADER]: Becoming Leader. State: Replica: f656e75456c24d679b2e68ce679451c4, State: Running, Role: LEADER
I20260808 15:01:40.222026 15878 sys_catalog.cc:564] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:40.222579 15896 consensus_queue.cc:237] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f656e75456c24d679b2e68ce679451c4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41117 } }
I20260808 15:01:40.225870 15899 sys_catalog.cc:455] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f656e75456c24d679b2e68ce679451c4. Latest consensus state: current_term: 1 leader_uuid: "f656e75456c24d679b2e68ce679451c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f656e75456c24d679b2e68ce679451c4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41117 } } }
I20260808 15:01:40.226294 15899 sys_catalog.cc:458] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:40.225850 15897 sys_catalog.cc:455] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f656e75456c24d679b2e68ce679451c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f656e75456c24d679b2e68ce679451c4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41117 } } }
I20260808 15:01:40.226715 15897 sys_catalog.cc:458] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:40.230175 15913 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:40.234277 15913 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:40.242376 15913 catalog_manager.cc:1347] Generated new cluster ID: 3893429519254bb7879a56ae87fe053f
I20260808 15:01:40.242496 15913 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:40.252897 15913 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:40.254189 15913 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:40.264497 15913 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f656e75456c24d679b2e68ce679451c4: Generated new TSK 0
I20260808 15:01:40.265372 15913 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:40.271265 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15767
W20260808 15:01:40.272655 15872 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.69:53547
W20260808 15:01:40.273520 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15767: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 15:01:40.273684 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 15767
W20260808 15:01:40.302724 15745 connection.cc:535] client connection to 127.0.0.1:41117 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41117): Connection reset by peer (error 104)
2026-08-08T15:01:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2234 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:40 dist-test-slave-z8x9 krb5kdc[15936](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:40 dist-test-slave-z8x9 krb5kdc[15936](info): set up 2 sockets
Aug 08 15:01:40 dist-test-slave-z8x9 krb5kdc[15936](info): commencing operation
krb5kdc: starting...
W20260808 15:01:41.643559 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.001s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:41 dist-test-slave-z8x9 krb5kdc[15936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:01:41.978822 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43013
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43013
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:42.327756 15959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:42.328058 15959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:42.328238 15959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:42.335554 15959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:42.335705 15959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:42.335800 15959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:42.335913 15959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:42.335999 15959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:42.346196 15959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43013
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:42.347532 15959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:42.348901 15959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:42.361276 15969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:42.361480 15970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:42.361344 15973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:42.362427 15959 server_base.cc:1034] running on GCE node
I20260808 15:01:42.363216 15959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:42.364619 15959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:42.365841 15959 hybrid_clock.cc:648] HybridClock initialized: now 1786201302365786 us; error 48 us; skew 500 ppm
I20260808 15:01:42.366245 15959 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:42 dist-test-slave-z8x9 krb5kdc[15936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201302, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:42.373780 15959 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:01:42.375303 15959 webserver.cc:460] Webserver started at http://127.0.0.1:34797/ using document root <none> and password file <none>
I20260808 15:01:42.376003 15959 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:42.376164 15959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:42.376492 15959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:42.379514 15959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "1185dfc5dff048dbac9889cb45e85214"
format_stamp: "Formatted at 2026-08-08 15:01:42 on dist-test-slave-z8x9"
server_key: "e4744bb7dc06933cf828138b0a4bd435"
server_key_iv: "2f08ebe0e54c49e8efc88d0b8fbd5237"
server_key_version: "encryptionkey@0"
I20260808 15:01:42.380295 15959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "1185dfc5dff048dbac9889cb45e85214"
format_stamp: "Formatted at 2026-08-08 15:01:42 on dist-test-slave-z8x9"
server_key: "e4744bb7dc06933cf828138b0a4bd435"
server_key_iv: "2f08ebe0e54c49e8efc88d0b8fbd5237"
server_key_version: "encryptionkey@0"
I20260808 15:01:42.385396 15959 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 15:01:42.388638 15982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:42.389977 15959 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:01:42.390168 15959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "1185dfc5dff048dbac9889cb45e85214"
format_stamp: "Formatted at 2026-08-08 15:01:42 on dist-test-slave-z8x9"
server_key: "e4744bb7dc06933cf828138b0a4bd435"
server_key_iv: "2f08ebe0e54c49e8efc88d0b8fbd5237"
server_key_version: "encryptionkey@0"
I20260808 15:01:42.390367 15959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:42.396045 15959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:42.400503 15959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:42.400816 15959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:42.419945 15959 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43013
I20260808 15:01:42.419983 16076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43013 every 8 connection(s)
I20260808 15:01:42.421418 15959 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:42.421944 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 15959
I20260808 15:01:42.422148 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:42.422640 12582 external_mini_cluster.cc:1428] Setting key ce5e619df62cb916d20239a12061fe1f
I20260808 15:01:42.426074 16077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:42.430410 16082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:42.424496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:42429 (local address 127.0.0.1:43013)
0808 15:01:42.425332 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:42.425344 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:42.425388 (+ 44us) server_negotiation.cc:407] Connection header received
0808 15:01:42.427103 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:42.427125 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:42.427434 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:42.427743 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:42.428838 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:42.428844 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:42.428859 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:42.428873 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:42.428952 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:42.428971 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:42.429138 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:42.429333 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 15:01:42.429546 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":365,"threads_started":1}
I20260808 15:01:42.434489 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:42.439385 16077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214: Bootstrap starting.
I20260808 15:01:42.442514 16082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:42.439815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:50607 (local address 127.0.0.1:43013)
0808 15:01:42.439996 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:42.440003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:42.440538 (+ 535us) server_negotiation.cc:407] Connection header received
0808 15:01:42.440665 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:42.440671 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:42.440730 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:42.440864 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:42.441881 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:42.441886 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:42.441890 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:42.441907 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:42.441953 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:42.441971 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:42.442089 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:42.442158 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 15:01:42.442213 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:01:42.443324 16077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:42.444427 16077 log.cc:824] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:42.447008 16077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214: No bootstrap required, opened a new log
I20260808 15:01:42.454152 16077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1185dfc5dff048dbac9889cb45e85214" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43013 } }
I20260808 15:01:42.454526 16077 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:42.454643 16077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1185dfc5dff048dbac9889cb45e85214, State: Initialized, Role: FOLLOWER
I20260808 15:01:42.455313 16077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1185dfc5dff048dbac9889cb45e85214" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43013 } }
I20260808 15:01:42.455528 16077 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:42.455627 16077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:42.455751 16077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:42.457902 16077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1185dfc5dff048dbac9889cb45e85214" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43013 } }
I20260808 15:01:42.458323 16077 leader_election.cc:302] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1185dfc5dff048dbac9889cb45e85214; no voters:
I20260808 15:01:42.458871 16077 leader_election.cc:288] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:42.459054 16092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:42.459771 16092 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [term 1 LEADER]: Becoming Leader. State: Replica: 1185dfc5dff048dbac9889cb45e85214, State: Running, Role: LEADER
I20260808 15:01:42.460316 16092 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1185dfc5dff048dbac9889cb45e85214" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43013 } }
I20260808 15:01:42.460915 16077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:42.463645 16097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1185dfc5dff048dbac9889cb45e85214. Latest consensus state: current_term: 1 leader_uuid: "1185dfc5dff048dbac9889cb45e85214" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1185dfc5dff048dbac9889cb45e85214" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43013 } } }
I20260808 15:01:42.464190 16097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:42.463665 16094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1185dfc5dff048dbac9889cb45e85214" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1185dfc5dff048dbac9889cb45e85214" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43013 } } }
I20260808 15:01:42.464432 16094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:42.465764 16110 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:42.471038 16110 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:42.479414 16110 catalog_manager.cc:1347] Generated new cluster ID: da67e612cea74e459094d8f8da2263c9
I20260808 15:01:42.479521 16110 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:42.518776 16110 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:42.519232 16110 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:42.530675 16110 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1185dfc5dff048dbac9889cb45e85214: Generated new TSK 0
I20260808 15:01:42.531491 16110 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:42.540930 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15959
W20260808 15:01:42.542532 16067 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.69:42429
W20260808 15:01:42.543224 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 15959: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 15:01:42.543367 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 15959
2026-08-08T15:01:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2264 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:42 dist-test-slave-z8x9 krb5kdc[16132](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:42 dist-test-slave-z8x9 krb5kdc[16132](info): set up 2 sockets
Aug 08 15:01:42 dist-test-slave-z8x9 krb5kdc[16132](info): commencing operation
krb5kdc: starting...
W20260808 15:01:43.929773 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.343s user 0.006s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:44 dist-test-slave-z8x9 krb5kdc[16132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:01:44.265161 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36291
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36291
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:44.604511 16154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:44.604799 16154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:44.604928 16154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:44.612012 16154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:44.612118 16154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:44.612166 16154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:44.612270 16154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:44.612360 16154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:44.622180 16154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36291
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:44.623452 16154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:44.624769 16154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:44.636451 16164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:44.636549 16167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:44.636497 16169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:44.637748 16154 server_base.cc:1034] running on GCE node
I20260808 15:01:44.638545 16154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:44.639858 16154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:44.641063 16154 hybrid_clock.cc:648] HybridClock initialized: now 1786201304641021 us; error 40 us; skew 500 ppm
I20260808 15:01:44.641443 16154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:44 dist-test-slave-z8x9 krb5kdc[16132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201304, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:44.644568 16154 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:01:44.646134 16154 webserver.cc:460] Webserver started at http://127.0.0.1:43343/ using document root <none> and password file <none>
I20260808 15:01:44.646760 16154 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:44.646862 16154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:44.647125 16154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:44.650063 16154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "066eaf8a1f384e229119cb25e5c92f32"
format_stamp: "Formatted at 2026-08-08 15:01:44 on dist-test-slave-z8x9"
server_key: "928a464534af43ae1f58ba069cc34f44"
server_key_iv: "50754f63b36cb2b2c50c1e40b74191d3"
server_key_version: "encryptionkey@0"
I20260808 15:01:44.650784 16154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "066eaf8a1f384e229119cb25e5c92f32"
format_stamp: "Formatted at 2026-08-08 15:01:44 on dist-test-slave-z8x9"
server_key: "928a464534af43ae1f58ba069cc34f44"
server_key_iv: "50754f63b36cb2b2c50c1e40b74191d3"
server_key_version: "encryptionkey@0"
I20260808 15:01:44.655637 16154 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 15:01:44.658951 16183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:44.660462 16154 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 15:01:44.660645 16154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "066eaf8a1f384e229119cb25e5c92f32"
format_stamp: "Formatted at 2026-08-08 15:01:44 on dist-test-slave-z8x9"
server_key: "928a464534af43ae1f58ba069cc34f44"
server_key_iv: "50754f63b36cb2b2c50c1e40b74191d3"
server_key_version: "encryptionkey@0"
I20260808 15:01:44.660887 16154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:44.691401 16154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:44.695325 16154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:44.695571 16154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:44.714280 16154 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36291
I20260808 15:01:44.714324 16273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36291 every 8 connection(s)
I20260808 15:01:44.715677 16154 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:44.718348 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 16154
I20260808 15:01:44.718535 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:44.718997 12582 external_mini_cluster.cc:1428] Setting key b8a06c6f1e8569843572902cb6e9656e
I20260808 15:01:44.719478 16274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:44.733451 16274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32: Bootstrap starting.
Aug 08 15:01:44 dist-test-slave-z8x9 krb5kdc[16132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 15:01:44.736923 16274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:44.738370 16274 log.cc:824] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:44.741561 16274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32: No bootstrap required, opened a new log
I20260808 15:01:44.744029 16279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:44.720792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:54023 (local address 127.0.0.1:36291)
0808 15:01:44.721637 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:44.721652 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:44.721701 (+ 49us) server_negotiation.cc:407] Connection header received
0808 15:01:44.724162 (+ 2461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:44.724191 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:44.724691 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:44.725100 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:44.726471 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:44.728435 (+ 1964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:44.729875 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:44.730981 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:44.731181 (+ 200us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:44.735421 (+ 4240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:44.735432 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:44.735450 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:44.735491 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:44.739481 (+ 3990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:44.740289 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:44.740297 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:44.740304 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:44.740529 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:44.740975 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:44.740983 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:44.740986 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:44.741689 (+ 703us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:44.742026 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:44.742402 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 15:01:44.742725 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":353,"threads_started":1}
I20260808 15:01:44.747936 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:44.750699 16274 raft_consensus.cc:348] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "066eaf8a1f384e229119cb25e5c92f32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36291 } }
I20260808 15:01:44.751106 16274 raft_consensus.cc:374] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:44.751221 16274 raft_consensus.cc:729] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066eaf8a1f384e229119cb25e5c92f32, State: Initialized, Role: FOLLOWER
I20260808 15:01:44.751870 16274 consensus_queue.cc:260] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "066eaf8a1f384e229119cb25e5c92f32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36291 } }
I20260808 15:01:44.752256 16274 raft_consensus.cc:388] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:44.752441 16274 raft_consensus.cc:482] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:44.752729 16274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:44.755128 16274 raft_consensus.cc:504] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "066eaf8a1f384e229119cb25e5c92f32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36291 } }
I20260808 15:01:44.755676 16274 leader_election.cc:302] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 066eaf8a1f384e229119cb25e5c92f32; no voters:
I20260808 15:01:44.756385 16274 leader_election.cc:288] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:44.756479 16289 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:44.759085 16274 sys_catalog.cc:564] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:44.763163 16289 raft_consensus.cc:686] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [term 1 LEADER]: Becoming Leader. State: Replica: 066eaf8a1f384e229119cb25e5c92f32, State: Running, Role: LEADER
I20260808 15:01:44.763871 16289 consensus_queue.cc:237] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "066eaf8a1f384e229119cb25e5c92f32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36291 } }
I20260808 15:01:44.767251 16279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:44.752333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:53149 (local address 127.0.0.1:36291)
0808 15:01:44.752574 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:44.752582 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:44.753050 (+ 468us) server_negotiation.cc:407] Connection header received
0808 15:01:44.753284 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:44.753288 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:44.753354 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:44.753467 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:44.754955 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:44.755854 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:44.757452 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:44.757877 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:44.758012 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:44.760581 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:44.760587 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:44.760590 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:44.760638 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:44.763827 (+ 3189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:44.764619 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:44.764625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:44.764628 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:44.764751 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:44.765281 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:44.765291 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:44.765293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:44.765753 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:44.766054 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:44.766699 (+ 645us) server_negotiation.cc:299] Negotiation successful
0808 15:01:44.766878 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":93}
I20260808 15:01:44.772044 16293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 066eaf8a1f384e229119cb25e5c92f32. Latest consensus state: current_term: 1 leader_uuid: "066eaf8a1f384e229119cb25e5c92f32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "066eaf8a1f384e229119cb25e5c92f32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36291 } } }
I20260808 15:01:44.772420 16293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:44.773479 16291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "066eaf8a1f384e229119cb25e5c92f32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "066eaf8a1f384e229119cb25e5c92f32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36291 } } }
I20260808 15:01:44.773914 16291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32 [sys.catalog]: This master's current role is: LEADER
W20260808 15:01:44.779122 16316 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:01:44.779263 16316 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 15:01:44.779410 16317 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:44.781129 16317 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:44.789548 16317 catalog_manager.cc:1347] Generated new cluster ID: b0744ab7fffd4c9ea614a9b0fbd96ae7
I20260808 15:01:44.789664 16317 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:44.796756 16317 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:44.798641 16317 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:44.806636 16317 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 066eaf8a1f384e229119cb25e5c92f32: Generated new TSK 0
I20260808 15:01:44.807651 16317 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:44.813439 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16154
I20260808 15:01:44.814491 16263 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:44.904876 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 16154
W20260808 15:01:44.928488 16125 connection.cc:535] client connection to 127.0.0.1:36291 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36291): Connection reset by peer (error 104)
2026-08-08T15:01:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2361 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:45 dist-test-slave-z8x9 krb5kdc[16334](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:45 dist-test-slave-z8x9 krb5kdc[16334](info): set up 2 sockets
Aug 08 15:01:45 dist-test-slave-z8x9 krb5kdc[16334](info): commencing operation
krb5kdc: starting...
W20260808 15:01:46.269867 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.005s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:46 dist-test-slave-z8x9 krb5kdc[16334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:01:46.594759 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39663
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:46.937309 16356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:46.937602 16356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:46.937770 16356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:46.945082 16356 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:46.945204 16356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:46.945297 16356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:46.945410 16356 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:46.945489 16356 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:46.955404 16356 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39663
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:46.956730 16356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:46.958114 16356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:46.970278 16366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:46.970278 16370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:46.970265 16375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:46.971099 16356 server_base.cc:1034] running on GCE node
I20260808 15:01:46.971927 16356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:46.973449 16356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:46.974676 16356 hybrid_clock.cc:648] HybridClock initialized: now 1786201306974641 us; error 49 us; skew 500 ppm
I20260808 15:01:46.975025 16356 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:46 dist-test-slave-z8x9 krb5kdc[16334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201306, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:46.978402 16356 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:01:46.979964 16356 webserver.cc:460] Webserver started at http://127.0.0.1:46755/ using document root <none> and password file <none>
I20260808 15:01:46.980656 16356 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:46.980808 16356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:46.981117 16356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:46.984177 16356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "ff0c50fb49a845e68ae6f32ebcf85db3"
format_stamp: "Formatted at 2026-08-08 15:01:46 on dist-test-slave-z8x9"
server_key: "b9f90858cab52a1f9ba012ec4a2a0d5a"
server_key_iv: "669415a142c235b16c0da06ac3b7e9f6"
server_key_version: "encryptionkey@0"
I20260808 15:01:46.984956 16356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "ff0c50fb49a845e68ae6f32ebcf85db3"
format_stamp: "Formatted at 2026-08-08 15:01:46 on dist-test-slave-z8x9"
server_key: "b9f90858cab52a1f9ba012ec4a2a0d5a"
server_key_iv: "669415a142c235b16c0da06ac3b7e9f6"
server_key_version: "encryptionkey@0"
I20260808 15:01:46.990080 16356 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260808 15:01:46.993570 16386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:46.994844 16356 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:01:46.995038 16356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "ff0c50fb49a845e68ae6f32ebcf85db3"
format_stamp: "Formatted at 2026-08-08 15:01:46 on dist-test-slave-z8x9"
server_key: "b9f90858cab52a1f9ba012ec4a2a0d5a"
server_key_iv: "669415a142c235b16c0da06ac3b7e9f6"
server_key_version: "encryptionkey@0"
I20260808 15:01:46.995244 16356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:47.013095 16356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:47.016937 16356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:47.017256 16356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:47.036007 16356 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39663
I20260808 15:01:47.036051 16468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39663 every 8 connection(s)
I20260808 15:01:47.037472 16356 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:47.041013 16473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:47.044121 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 16356
I20260808 15:01:47.044333 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:47.044909 12582 external_mini_cluster.cc:1428] Setting key 93d32272e09f0035b18a38c660002770
I20260808 15:01:47.052740 16473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3: Bootstrap starting.
I20260808 15:01:47.055967 16473 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:47.057094 16473 log.cc:824] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:47.058336 16476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:47.046837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:47781 (local address 127.0.0.1:39663)
0808 15:01:47.047594 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:47.047611 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:47.047661 (+ 50us) server_negotiation.cc:407] Connection header received
0808 15:01:47.049431 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:47.049453 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:47.049844 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:47.050222 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:47.050811 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:47.052180 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:47.053616 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:47.054288 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:47.054486 (+ 198us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:47.055756 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:47.055763 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:47.055775 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:47.056346 (+ 571us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:47.056425 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:47.056450 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:47.056619 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:47.056907 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 15:01:47.057050 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":322,"threads_started":1}
I20260808 15:01:47.060241 16473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3: No bootstrap required, opened a new log
I20260808 15:01:47.062124 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:47.068517 16473 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff0c50fb49a845e68ae6f32ebcf85db3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39663 } }
I20260808 15:01:47.068904 16473 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:47.069026 16473 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0c50fb49a845e68ae6f32ebcf85db3, State: Initialized, Role: FOLLOWER
I20260808 15:01:47.069655 16473 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff0c50fb49a845e68ae6f32ebcf85db3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39663 } }
I20260808 15:01:47.069905 16473 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:47.070060 16473 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:47.070251 16473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:47.072645 16476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:47.066405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:36077 (local address 127.0.0.1:39663)
0808 15:01:47.066601 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:47.066610 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:47.066978 (+ 368us) server_negotiation.cc:407] Connection header received
0808 15:01:47.067190 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:47.067194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:47.067257 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:47.067389 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:47.067870 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:47.068606 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:47.070109 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:47.070633 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:47.070780 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:47.071919 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:47.071924 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:47.071927 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:47.071944 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:47.071980 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:47.071995 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:47.072113 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:47.072309 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 15:01:47.072369 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 15:01:47.072904 16473 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff0c50fb49a845e68ae6f32ebcf85db3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39663 } }
I20260808 15:01:47.073513 16473 leader_election.cc:302] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff0c50fb49a845e68ae6f32ebcf85db3; no voters:
I20260808 15:01:47.074170 16473 leader_election.cc:288] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:47.074285 16485 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:47.075007 16485 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [term 1 LEADER]: Becoming Leader. State: Replica: ff0c50fb49a845e68ae6f32ebcf85db3, State: Running, Role: LEADER
I20260808 15:01:47.075572 16485 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff0c50fb49a845e68ae6f32ebcf85db3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39663 } }
I20260808 15:01:47.076471 16473 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:47.078620 16488 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff0c50fb49a845e68ae6f32ebcf85db3. Latest consensus state: current_term: 1 leader_uuid: "ff0c50fb49a845e68ae6f32ebcf85db3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff0c50fb49a845e68ae6f32ebcf85db3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39663 } } }
I20260808 15:01:47.078701 16487 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff0c50fb49a845e68ae6f32ebcf85db3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff0c50fb49a845e68ae6f32ebcf85db3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39663 } } }
I20260808 15:01:47.079033 16488 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:47.079119 16487 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:47.086418 16494 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:47.091888 16494 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:47.100682 16494 catalog_manager.cc:1347] Generated new cluster ID: 5e75a507b51743899ba4ed1d7504a64c
I20260808 15:01:47.100811 16494 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:47.134485 16494 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:47.135810 16494 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:47.144145 16494 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff0c50fb49a845e68ae6f32ebcf85db3: Generated new TSK 0
I20260808 15:01:47.145190 16494 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:47.163918 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16356
W20260808 15:01:47.165417 16463 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.69:47781
W20260808 15:01:47.166149 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16356: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 15:01:47.166299 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 16356
W20260808 15:01:47.193734 16331 connection.cc:535] client connection to 127.0.0.1:39663 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39663): Connection reset by peer (error 104)
2026-08-08T15:01:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2264 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:47 dist-test-slave-z8x9 krb5kdc[16522](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:47 dist-test-slave-z8x9 krb5kdc[16522](info): set up 2 sockets
Aug 08 15:01:47 dist-test-slave-z8x9 krb5kdc[16522](info): commencing operation
krb5kdc: starting...
W20260808 15:01:48.537808 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.003s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:48 dist-test-slave-z8x9 krb5kdc[16522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 15:01:48.864724 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43431
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:49.201623 16541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:49.201892 16541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:49.202105 16541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:49.209084 16541 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:49.209246 16541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:49.209367 16541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:49.209479 16541 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:49.209563 16541 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:49.219177 16541 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43431
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:49.220395 16541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:49.221705 16541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:49.233574 16551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:49.233618 16552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:49.233600 16554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:49.234619 16541 server_base.cc:1034] running on GCE node
I20260808 15:01:49.235522 16541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:49.236840 16541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:49.238087 16541 hybrid_clock.cc:648] HybridClock initialized: now 1786201309238041 us; error 55 us; skew 500 ppm
I20260808 15:01:49.238483 16541 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:49 dist-test-slave-z8x9 krb5kdc[16522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201309, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:49.246706 16541 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 15:01:49.248106 16541 webserver.cc:460] Webserver started at http://127.0.0.1:34275/ using document root <none> and password file <none>
I20260808 15:01:49.248793 16541 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:49.248952 16541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:49.249349 16541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:49.252286 16541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "9c4c93224d514db0bc6a84115868dd22"
format_stamp: "Formatted at 2026-08-08 15:01:49 on dist-test-slave-z8x9"
server_key: "f4f692afd9125efb35b0ba01e704b82f"
server_key_iv: "625f9cf11178e3bcc1ebe382ac4807f7"
server_key_version: "encryptionkey@0"
I20260808 15:01:49.253054 16541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "9c4c93224d514db0bc6a84115868dd22"
format_stamp: "Formatted at 2026-08-08 15:01:49 on dist-test-slave-z8x9"
server_key: "f4f692afd9125efb35b0ba01e704b82f"
server_key_iv: "625f9cf11178e3bcc1ebe382ac4807f7"
server_key_version: "encryptionkey@0"
I20260808 15:01:49.258284 16541 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 15:01:49.261557 16570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:49.262841 16541 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:01:49.263022 16541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "9c4c93224d514db0bc6a84115868dd22"
format_stamp: "Formatted at 2026-08-08 15:01:49 on dist-test-slave-z8x9"
server_key: "f4f692afd9125efb35b0ba01e704b82f"
server_key_iv: "625f9cf11178e3bcc1ebe382ac4807f7"
server_key_version: "encryptionkey@0"
I20260808 15:01:49.263227 16541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:49.268797 16541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:49.273075 16541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:49.273415 16541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:49.294390 16541 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43431
I20260808 15:01:49.294407 16647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43431 every 8 connection(s)
I20260808 15:01:49.295892 16541 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:49.299526 16648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:49.305814 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 16541
I20260808 15:01:49.306005 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:49.306449 12582 external_mini_cluster.cc:1428] Setting key dedcb885f33874d11f9a902bcd2e9205
I20260808 15:01:49.309948 16648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22: Bootstrap starting.
I20260808 15:01:49.313375 16648 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:49.314314 16653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:49.308335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:40263 (local address 127.0.0.1:43431)
0808 15:01:49.309235 (+ 900us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:49.309249 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:49.309292 (+ 43us) server_negotiation.cc:407] Connection header received
0808 15:01:49.311013 (+ 1721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:49.311034 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:49.311359 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:49.311690 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:49.312741 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:49.312746 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:49.312758 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:49.312770 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:49.312819 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:49.312836 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:49.312976 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:49.313226 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 15:01:49.313437 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":380,"threads_started":1}
I20260808 15:01:49.314416 16648 log.cc:824] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:49.317386 16648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22: No bootstrap required, opened a new log
I20260808 15:01:49.317858 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:49.325809 16653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:49.322829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:45339 (local address 127.0.0.1:43431)
0808 15:01:49.323007 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:49.323014 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:49.323421 (+ 407us) server_negotiation.cc:407] Connection header received
0808 15:01:49.323673 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:49.323676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:49.323722 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:49.323848 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:49.325103 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:49.325110 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:49.325115 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:49.325134 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:49.325219 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:49.325244 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:49.325400 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:49.325478 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 15:01:49.325536 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:01:49.325796 16648 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c4c93224d514db0bc6a84115868dd22" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43431 } }
I20260808 15:01:49.326269 16648 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:49.326409 16648 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4c93224d514db0bc6a84115868dd22, State: Initialized, Role: FOLLOWER
I20260808 15:01:49.327057 16648 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c4c93224d514db0bc6a84115868dd22" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43431 } }
I20260808 15:01:49.327363 16648 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:49.327512 16648 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:49.327646 16648 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:49.330238 16648 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c4c93224d514db0bc6a84115868dd22" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43431 } }
I20260808 15:01:49.330674 16648 leader_election.cc:302] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c4c93224d514db0bc6a84115868dd22; no voters:
I20260808 15:01:49.331172 16648 leader_election.cc:288] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:49.331331 16666 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:49.332094 16666 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [term 1 LEADER]: Becoming Leader. State: Replica: 9c4c93224d514db0bc6a84115868dd22, State: Running, Role: LEADER
I20260808 15:01:49.332643 16666 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c4c93224d514db0bc6a84115868dd22" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43431 } }
I20260808 15:01:49.333249 16648 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:49.335688 16667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c4c93224d514db0bc6a84115868dd22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c4c93224d514db0bc6a84115868dd22" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43431 } } }
I20260808 15:01:49.336174 16667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:49.335721 16670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c4c93224d514db0bc6a84115868dd22. Latest consensus state: current_term: 1 leader_uuid: "9c4c93224d514db0bc6a84115868dd22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c4c93224d514db0bc6a84115868dd22" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43431 } } }
I20260808 15:01:49.336771 16670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:49.338781 16677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:49.343765 16677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:49.353380 16677 catalog_manager.cc:1347] Generated new cluster ID: e50882ae84694d8eba559cae4253b9c3
I20260808 15:01:49.353507 16677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:49.389969 16677 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:49.390475 16677 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:49.402559 16677 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c4c93224d514db0bc6a84115868dd22: Generated new TSK 0
I20260808 15:01:49.403534 16677 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:49.418653 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16541
W20260808 15:01:49.419786 16642 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.69:40263
W20260808 15:01:49.420439 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16541: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 15:01:49.420595 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 16541
2026-08-08T15:01:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2254 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:49 dist-test-slave-z8x9 krb5kdc[16696](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:49 dist-test-slave-z8x9 krb5kdc[16696](info): set up 2 sockets
Aug 08 15:01:49 dist-test-slave-z8x9 krb5kdc[16696](info): commencing operation
krb5kdc: starting...
W20260808 15:01:50.869385 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.402s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:51 dist-test-slave-z8x9 krb5kdc[16696](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 15:01:51.198753 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:37689
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:37911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:37689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:51.538761 16716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:51.539064 16716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:51.539207 16716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:51.546337 16716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:51.546440 16716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:51.546553 16716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:51.546659 16716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:51.546723 16716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:51.556293 16716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:37911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:37689
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:37689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:51.557646 16716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:51.558921 16716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:51.570639 16727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:51.570784 16722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:51.570658 16725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:51.571657 16716 server_base.cc:1034] running on GCE node
I20260808 15:01:51.572422 16716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:51.573791 16716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:51.575021 16716 hybrid_clock.cc:648] HybridClock initialized: now 1786201311574979 us; error 30 us; skew 500 ppm
I20260808 15:01:51.575425 16716 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:51 dist-test-slave-z8x9 krb5kdc[16696](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201311, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:51.578769 16716 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:01:51.580263 16716 webserver.cc:460] Webserver started at http://127.12.73.190:41963/ using document root <none> and password file <none>
I20260808 15:01:51.580951 16716 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:51.581113 16716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:51.581467 16716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:51.584434 16716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "f3dd197151ab4cb3aaad772a112eaba2"
format_stamp: "Formatted at 2026-08-08 15:01:51 on dist-test-slave-z8x9"
server_key: "95fc565b8c9fdd97cb05966a2cb09dcd"
server_key_iv: "63e95d4c2388c1f3a7b1b61af760127b"
server_key_version: "encryptionkey@0"
I20260808 15:01:51.585263 16716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "f3dd197151ab4cb3aaad772a112eaba2"
format_stamp: "Formatted at 2026-08-08 15:01:51 on dist-test-slave-z8x9"
server_key: "95fc565b8c9fdd97cb05966a2cb09dcd"
server_key_iv: "63e95d4c2388c1f3a7b1b61af760127b"
server_key_version: "encryptionkey@0"
I20260808 15:01:51.590396 16716 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 15:01:51.593865 16742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:51.595135 16716 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 15:01:51.595343 16716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "f3dd197151ab4cb3aaad772a112eaba2"
format_stamp: "Formatted at 2026-08-08 15:01:51 on dist-test-slave-z8x9"
server_key: "95fc565b8c9fdd97cb05966a2cb09dcd"
server_key_iv: "63e95d4c2388c1f3a7b1b61af760127b"
server_key_version: "encryptionkey@0"
I20260808 15:01:51.595552 16716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:51.616432 16716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:51.620481 16716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:51.620781 16716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:51.638906 16716 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:37689
I20260808 15:01:51.638942 16818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:37689 every 8 connection(s)
I20260808 15:01:51.640266 16716 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:51.641063 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 16716
I20260808 15:01:51.641294 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:51.641857 12582 external_mini_cluster.cc:1428] Setting key bfd67c71a6b5f7bde12fbc40069ab7e7
I20260808 15:01:51.644550 16820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 15:01:51 dist-test-slave-z8x9 krb5kdc[16696](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:51.658110 16820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2: Bootstrap starting.
I20260808 15:01:51.662073 16820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:51.663435 16820 log.cc:824] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:51.666846 16820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2: No bootstrap required, opened a new log
I20260808 15:01:51.668299 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:51.643825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55059 (local address 127.12.73.190:37689)
0808 15:01:51.644772 (+ 947us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:51.644788 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:51.645216 (+ 428us) server_negotiation.cc:407] Connection header received
0808 15:01:51.647618 (+ 2402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:51.647647 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:51.648191 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:51.648660 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:51.650128 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:51.652251 (+ 2123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:51.653598 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:51.654617 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:51.654829 (+ 212us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:51.659239 (+ 4410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:51.659251 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:51.659268 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:51.659317 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:51.663520 (+ 4203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:51.664435 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:51.664460 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:51.664465 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:51.664641 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:51.665133 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:51.665138 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:51.665141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:51.665817 (+ 676us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:51.666177 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:51.666593 (+ 416us) server_negotiation.cc:299] Negotiation successful
0808 15:01:51.666918 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":426,"threads_started":1}
I20260808 15:01:51.672164 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:51.676455 16820 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3dd197151ab4cb3aaad772a112eaba2" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 37689 } }
I20260808 15:01:51.676916 16820 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:51.677033 16820 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3dd197151ab4cb3aaad772a112eaba2, State: Initialized, Role: FOLLOWER
I20260808 15:01:51.677788 16820 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3dd197151ab4cb3aaad772a112eaba2" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 37689 } }
I20260808 15:01:51.678102 16820 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:51.678277 16820 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:51.678472 16820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:51.681703 16820 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3dd197151ab4cb3aaad772a112eaba2" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 37689 } }
I20260808 15:01:51.682318 16820 leader_election.cc:302] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3dd197151ab4cb3aaad772a112eaba2; no voters:
I20260808 15:01:51.682983 16820 leader_election.cc:288] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:51.683084 16839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:51.683818 16839 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [term 1 LEADER]: Becoming Leader. State: Replica: f3dd197151ab4cb3aaad772a112eaba2, State: Running, Role: LEADER
I20260808 15:01:51.684479 16839 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3dd197151ab4cb3aaad772a112eaba2" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 37689 } }
I20260808 15:01:51.686316 16839 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3dd197151ab4cb3aaad772a112eaba2. Latest consensus state: current_term: 1 leader_uuid: "f3dd197151ab4cb3aaad772a112eaba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3dd197151ab4cb3aaad772a112eaba2" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 37689 } } }
I20260808 15:01:51.686673 16839 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:51.690521 16841 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3dd197151ab4cb3aaad772a112eaba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3dd197151ab4cb3aaad772a112eaba2" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 37689 } } }
I20260808 15:01:51.690930 16841 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:51.691960 16820 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:51.694916 16848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:51.698146 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:51.677647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46299 (local address 127.12.73.190:37689)
0808 15:01:51.677833 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:51.677839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:51.678255 (+ 416us) server_negotiation.cc:407] Connection header received
0808 15:01:51.678493 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:51.678496 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:51.678584 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:51.678669 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:51.680705 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:51.681544 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:51.683376 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:51.684168 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:51.684356 (+ 188us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:51.688265 (+ 3909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:51.688274 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:51.688282 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:51.688335 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:51.693741 (+ 5406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:51.694992 (+ 1251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:51.694998 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:51.695005 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:51.695253 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:51.695861 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:51.695868 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:51.695874 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:51.696414 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:51.697500 (+ 1086us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:51.697700 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 15:01:51.697899 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 15:01:51.700682 16848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:51.709301 16848 catalog_manager.cc:1347] Generated new cluster ID: 795782006b9743809227e8de8ff25049
I20260808 15:01:51.709424 16848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:51.722306 16848 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:51.723644 16848 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:51.733016 16848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3dd197151ab4cb3aaad772a112eaba2: Generated new TSK 0
I20260808 15:01:51.734193 16848 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:51.746941 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16716
I20260808 15:01:51.748339 16812 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:51.839219 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 16716
W20260808 15:01:51.867064 16694 connection.cc:535] client connection to 127.12.73.190:37689 recv error: Network error: failed to read from TLS socket (remote: 127.12.73.190:37689): Connection reset by peer (error 104)
2026-08-08T15:01:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2418 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:51 dist-test-slave-z8x9 krb5kdc[16877](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:51 dist-test-slave-z8x9 krb5kdc[16877](info): set up 2 sockets
Aug 08 15:01:51 dist-test-slave-z8x9 krb5kdc[16877](info): commencing operation
krb5kdc: starting...
W20260808 15:01:53.214128 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.328s user 0.004s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:53 dist-test-slave-z8x9 krb5kdc[16877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 15:01:53.538604 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34829
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:42105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:34829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:53.878453 16895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:53.878736 16895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:53.878896 16895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:53.886000 16895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:53.886127 16895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:53.886250 16895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:53.886351 16895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:53.886445 16895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:53.896448 16895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:42105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:34829
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:53.897835 16895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:53.899112 16895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:53.910976 16903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:53.911039 16904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:53.910934 16906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:53.912221 16895 server_base.cc:1034] running on GCE node
I20260808 15:01:53.912935 16895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:53.914347 16895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:53.915596 16895 hybrid_clock.cc:648] HybridClock initialized: now 1786201313915558 us; error 46 us; skew 500 ppm
I20260808 15:01:53.915968 16895 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:53 dist-test-slave-z8x9 krb5kdc[16877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201313, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:53.919420 16895 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:01:53.920917 16895 webserver.cc:460] Webserver started at http://127.12.73.190:33849/ using document root <none> and password file <none>
I20260808 15:01:53.921622 16895 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:53.921727 16895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:53.921984 16895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:53.924850 16895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "7623c84e2f504d6fb34a762f1ba104fd"
format_stamp: "Formatted at 2026-08-08 15:01:53 on dist-test-slave-z8x9"
server_key: "57622699d9dc8ce591ef875c7428e97a"
server_key_iv: "eb68781f73bc2c45a29d033aaa4ed0c6"
server_key_version: "encryptionkey@0"
I20260808 15:01:53.925649 16895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "7623c84e2f504d6fb34a762f1ba104fd"
format_stamp: "Formatted at 2026-08-08 15:01:53 on dist-test-slave-z8x9"
server_key: "57622699d9dc8ce591ef875c7428e97a"
server_key_iv: "eb68781f73bc2c45a29d033aaa4ed0c6"
server_key_version: "encryptionkey@0"
I20260808 15:01:53.930671 16895 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 15:01:53.934166 16920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:53.935484 16895 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:01:53.935675 16895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "7623c84e2f504d6fb34a762f1ba104fd"
format_stamp: "Formatted at 2026-08-08 15:01:53 on dist-test-slave-z8x9"
server_key: "57622699d9dc8ce591ef875c7428e97a"
server_key_iv: "eb68781f73bc2c45a29d033aaa4ed0c6"
server_key_version: "encryptionkey@0"
I20260808 15:01:53.935890 16895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:53.954839 16895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:53.958982 16895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:53.959280 16895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:53.977499 16895 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:34829
I20260808 15:01:53.977519 17002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:34829 every 8 connection(s)
I20260808 15:01:53.978904 16895 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:53.981130 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 16895
I20260808 15:01:53.981413 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:53.981894 12582 external_mini_cluster.cc:1428] Setting key 7d480cb3f3f6a6cfbbc5ad765e02c350
I20260808 15:01:53.982945 17004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:53.996456 17010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:53.983635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39555 (local address 127.12.73.190:34829)
0808 15:01:53.984439 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:53.984453 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:53.984501 (+ 48us) server_negotiation.cc:407] Connection header received
0808 15:01:53.986463 (+ 1962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:53.986490 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:53.986989 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:53.987428 (+ 439us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:53.987936 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:53.989995 (+ 2059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:53.991269 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:53.992275 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:53.992462 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:53.993705 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:53.993715 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:53.993732 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:53.994487 (+ 755us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:53.994578 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:53.994618 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:53.994795 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:53.995054 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 15:01:53.995222 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":354,"threads_started":1}
I20260808 15:01:53.998071 17004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd: Bootstrap starting.
I20260808 15:01:54.000545 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:54.001425 17004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:54.002386 17004 log.cc:824] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:54.005733 17004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd: No bootstrap required, opened a new log
I20260808 15:01:54.011380 17010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:54.005035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54073 (local address 127.12.73.190:34829)
0808 15:01:54.005224 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:54.005232 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:54.005644 (+ 412us) server_negotiation.cc:407] Connection header received
0808 15:01:54.005852 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:54.005857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:54.005931 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:54.006038 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:54.006567 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:54.007381 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:54.008719 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:54.009214 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:54.009361 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:54.010584 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:54.010589 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:54.010593 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:54.010609 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:54.010672 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:54.010687 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:54.010825 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:54.011040 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 15:01:54.011092 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 15:01:54.013581 17004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7623c84e2f504d6fb34a762f1ba104fd" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34829 } }
I20260808 15:01:54.013969 17004 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:54.014082 17004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7623c84e2f504d6fb34a762f1ba104fd, State: Initialized, Role: FOLLOWER
I20260808 15:01:54.014634 17004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7623c84e2f504d6fb34a762f1ba104fd" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34829 } }
I20260808 15:01:54.014881 17004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:54.015030 17004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:54.015218 17004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:54.017527 17004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7623c84e2f504d6fb34a762f1ba104fd" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34829 } }
I20260808 15:01:54.018011 17004 leader_election.cc:302] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7623c84e2f504d6fb34a762f1ba104fd; no voters:
I20260808 15:01:54.018663 17004 leader_election.cc:288] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:54.018778 17025 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:54.019737 17025 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [term 1 LEADER]: Becoming Leader. State: Replica: 7623c84e2f504d6fb34a762f1ba104fd, State: Running, Role: LEADER
I20260808 15:01:54.020289 17025 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7623c84e2f504d6fb34a762f1ba104fd" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34829 } }
I20260808 15:01:54.021034 17004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:54.023478 17026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7623c84e2f504d6fb34a762f1ba104fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7623c84e2f504d6fb34a762f1ba104fd" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34829 } } }
I20260808 15:01:54.023953 17026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:54.024384 17031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7623c84e2f504d6fb34a762f1ba104fd. Latest consensus state: current_term: 1 leader_uuid: "7623c84e2f504d6fb34a762f1ba104fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7623c84e2f504d6fb34a762f1ba104fd" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34829 } } }
I20260808 15:01:54.024765 17031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:54.030472 17042 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:54.035501 17042 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:54.044844 17042 catalog_manager.cc:1347] Generated new cluster ID: 63a231854d8b418dbdf2d782475b3150
I20260808 15:01:54.044984 17042 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:54.059741 17042 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:54.060968 17042 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:54.067360 17042 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7623c84e2f504d6fb34a762f1ba104fd: Generated new TSK 0
I20260808 15:01:54.068125 17042 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:54.077973 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16895
W20260808 15:01:54.079561 16998 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39555
W20260808 15:01:54.080348 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 16895: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 15:01:54.080502 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 16895
W20260808 15:01:54.108047 16874 connection.cc:535] client connection to 127.12.73.190:34829 recv error: Network error: failed to read from TLS socket (remote: 127.12.73.190:34829): Connection reset by peer (error 104)
2026-08-08T15:01:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2240 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:54 dist-test-slave-z8x9 krb5kdc[17063](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:54 dist-test-slave-z8x9 krb5kdc[17063](info): set up 2 sockets
Aug 08 15:01:54 dist-test-slave-z8x9 krb5kdc[17063](info): commencing operation
krb5kdc: starting...
W20260808 15:01:55.452391 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.006s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:55 dist-test-slave-z8x9 krb5kdc[17063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 15:01:55.776728 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34507
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:42915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:34507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:56.119679 17087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:56.119983 17087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:56.120079 17087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:56.127497 17087 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:56.127599 17087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:56.127646 17087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:56.127729 17087 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:56.127775 17087 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:56.137564 17087 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:42915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:34507
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:56.138800 17087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:56.140057 17087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:56.151777 17096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:56.151783 17102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:56.151803 17104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:56.152668 17087 server_base.cc:1034] running on GCE node
I20260808 15:01:56.153502 17087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:56.154886 17087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:56.156093 17087 hybrid_clock.cc:648] HybridClock initialized: now 1786201316156049 us; error 32 us; skew 500 ppm
I20260808 15:01:56.156442 17087 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:56 dist-test-slave-z8x9 krb5kdc[17063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201316, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:56.165062 17087 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:01:56.166719 17087 webserver.cc:460] Webserver started at http://127.12.73.190:44753/ using document root <none> and password file <none>
I20260808 15:01:56.167424 17087 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:56.167559 17087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:56.167884 17087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:56.170954 17087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "abbef8a6b3364f72a38329becaa6d28c"
format_stamp: "Formatted at 2026-08-08 15:01:56 on dist-test-slave-z8x9"
server_key: "9af1843351a674b12c35c8333c7f8b8f"
server_key_iv: "272894e2e91729a44c78310d60c4776b"
server_key_version: "encryptionkey@0"
I20260808 15:01:56.171721 17087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "abbef8a6b3364f72a38329becaa6d28c"
format_stamp: "Formatted at 2026-08-08 15:01:56 on dist-test-slave-z8x9"
server_key: "9af1843351a674b12c35c8333c7f8b8f"
server_key_iv: "272894e2e91729a44c78310d60c4776b"
server_key_version: "encryptionkey@0"
I20260808 15:01:56.177137 17087 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 15:01:56.180611 17115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:56.181986 17087 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:01:56.182176 17087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "abbef8a6b3364f72a38329becaa6d28c"
format_stamp: "Formatted at 2026-08-08 15:01:56 on dist-test-slave-z8x9"
server_key: "9af1843351a674b12c35c8333c7f8b8f"
server_key_iv: "272894e2e91729a44c78310d60c4776b"
server_key_version: "encryptionkey@0"
I20260808 15:01:56.182381 17087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:56.188163 17087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:56.192211 17087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:56.192524 17087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:56.211504 17087 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:34507
I20260808 15:01:56.211540 17209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:34507 every 8 connection(s)
I20260808 15:01:56.212967 17087 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:56.216754 17211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:56.218236 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 17087
I20260808 15:01:56.218431 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:56.218921 12582 external_mini_cluster.cc:1428] Setting key b0dbae197b8c5e9b061fe2191655a1a5
I20260808 15:01:56.227682 17217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:56.220832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46525 (local address 127.12.73.190:34507)
0808 15:01:56.221815 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:56.221835 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:56.221896 (+ 61us) server_negotiation.cc:407] Connection header received
0808 15:01:56.223751 (+ 1855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:56.223783 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:56.224264 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:56.224751 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:56.225771 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:56.225787 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:56.225804 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:56.225821 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:56.225890 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:56.225921 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:56.226139 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:56.226274 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 15:01:56.226458 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":409,"threads_started":1}
I20260808 15:01:56.231405 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:56.231626 17211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c: Bootstrap starting.
I20260808 15:01:56.234741 17211 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:56.235918 17211 log.cc:824] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c: Log is configured to *not* fsync() on all Append() calls
I20260808 15:01:56.238832 17217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:56.235974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39817 (local address 127.12.73.190:34507)
0808 15:01:56.236160 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:56.236166 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:56.236557 (+ 391us) server_negotiation.cc:407] Connection header received
0808 15:01:56.236741 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:56.236745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:56.236792 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:56.236876 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:56.238116 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:56.238121 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:56.238126 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:01:56.238146 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:56.238194 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:01:56.238214 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:56.238339 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:56.238463 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 15:01:56.238526 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 15:01:56.239785 17211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c: No bootstrap required, opened a new log
I20260808 15:01:56.247782 17211 raft_consensus.cc:348] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abbef8a6b3364f72a38329becaa6d28c" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34507 } }
I20260808 15:01:56.248324 17211 raft_consensus.cc:374] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:56.248478 17211 raft_consensus.cc:729] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abbef8a6b3364f72a38329becaa6d28c, State: Initialized, Role: FOLLOWER
I20260808 15:01:56.249101 17211 consensus_queue.cc:260] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abbef8a6b3364f72a38329becaa6d28c" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34507 } }
I20260808 15:01:56.249439 17211 raft_consensus.cc:388] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:56.249598 17211 raft_consensus.cc:482] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:56.249778 17211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:56.251963 17211 raft_consensus.cc:504] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abbef8a6b3364f72a38329becaa6d28c" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34507 } }
I20260808 15:01:56.252591 17211 leader_election.cc:302] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abbef8a6b3364f72a38329becaa6d28c; no voters:
I20260808 15:01:56.253300 17211 leader_election.cc:288] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:56.253453 17226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:56.254184 17226 raft_consensus.cc:686] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [term 1 LEADER]: Becoming Leader. State: Replica: abbef8a6b3364f72a38329becaa6d28c, State: Running, Role: LEADER
I20260808 15:01:56.254698 17226 consensus_queue.cc:237] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abbef8a6b3364f72a38329becaa6d28c" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34507 } }
I20260808 15:01:56.255460 17211 sys_catalog.cc:564] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:56.257927 17230 sys_catalog.cc:455] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [sys.catalog]: SysCatalogTable state changed. Reason: New leader abbef8a6b3364f72a38329becaa6d28c. Latest consensus state: current_term: 1 leader_uuid: "abbef8a6b3364f72a38329becaa6d28c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abbef8a6b3364f72a38329becaa6d28c" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34507 } } }
I20260808 15:01:56.258440 17230 sys_catalog.cc:458] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:56.258090 17229 sys_catalog.cc:455] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abbef8a6b3364f72a38329becaa6d28c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abbef8a6b3364f72a38329becaa6d28c" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34507 } } }
I20260808 15:01:56.258658 17229 sys_catalog.cc:458] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:56.260830 17239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:56.264810 17239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:56.273263 17239 catalog_manager.cc:1347] Generated new cluster ID: 080b77551799433badb2398f1a089c38
I20260808 15:01:56.273378 17239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:56.292146 17239 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:56.292662 17239 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:56.320254 17239 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abbef8a6b3364f72a38329becaa6d28c: Generated new TSK 0
I20260808 15:01:56.321331 17239 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:56.337692 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17087
W20260808 15:01:56.338960 17197 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46525
W20260808 15:01:56.339673 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17087: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 15:01:56.339814 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 17087
2026-08-08T15:01:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2260 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:56 dist-test-slave-z8x9 krb5kdc[17258](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:56 dist-test-slave-z8x9 krb5kdc[17258](info): set up 2 sockets
Aug 08 15:01:56 dist-test-slave-z8x9 krb5kdc[17258](info): commencing operation
krb5kdc: starting...
W20260808 15:01:57.709250 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:01:57 dist-test-slave-z8x9 krb5kdc[17258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:01:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:01:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 15:01:58.049525 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:38967
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:38839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:38967
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:01:58.394387 17276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:01:58.394666 17276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:01:58.394791 17276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:01:58.401888 17276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:01:58.402015 17276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:01:58.402119 17276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:01:58.402230 17276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:01:58.402309 17276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:01:58.411756 17276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:38839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:38967
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:38967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:01:58.412956 17276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:01:58.414297 17276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:01:58.426097 17287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:58.425935 17291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:01:58.426097 17286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:01:58.426753 17276 server_base.cc:1034] running on GCE node
I20260808 15:01:58.427575 17276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:01:58.428936 17276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:01:58.430166 17276 hybrid_clock.cc:648] HybridClock initialized: now 1786201318430096 us; error 78 us; skew 500 ppm
I20260808 15:01:58.430552 17276 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:01:58 dist-test-slave-z8x9 krb5kdc[17258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:01:58.433668 17276 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:01:58.435158 17276 webserver.cc:460] Webserver started at http://127.12.73.190:35549/ using document root <none> and password file <none>
I20260808 15:01:58.435854 17276 fs_manager.cc:359] Metadata directory not provided
I20260808 15:01:58.436002 17276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:01:58.436326 17276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:01:58.439498 17276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "62c109ab479647bbbf0ff22495e04861"
format_stamp: "Formatted at 2026-08-08 15:01:58 on dist-test-slave-z8x9"
server_key: "7e97f469dbceb0fc1b97b25cbb7ca8fa"
server_key_iv: "762aa54ffa4974da221d97dd8841590d"
server_key_version: "encryptionkey@0"
I20260808 15:01:58.440303 17276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "62c109ab479647bbbf0ff22495e04861"
format_stamp: "Formatted at 2026-08-08 15:01:58 on dist-test-slave-z8x9"
server_key: "7e97f469dbceb0fc1b97b25cbb7ca8fa"
server_key_iv: "762aa54ffa4974da221d97dd8841590d"
server_key_version: "encryptionkey@0"
I20260808 15:01:58.445472 17276 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 15:01:58.448741 17307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:01:58.450002 17276 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:01:58.450188 17276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "62c109ab479647bbbf0ff22495e04861"
format_stamp: "Formatted at 2026-08-08 15:01:58 on dist-test-slave-z8x9"
server_key: "7e97f469dbceb0fc1b97b25cbb7ca8fa"
server_key_iv: "762aa54ffa4974da221d97dd8841590d"
server_key_version: "encryptionkey@0"
I20260808 15:01:58.450426 17276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:01:58.480921 17276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:01:58.484748 17276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:01:58.485045 17276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:01:58.503517 17276 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:38967
I20260808 15:01:58.503537 17396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:38967 every 8 connection(s)
I20260808 15:01:58.504848 17276 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:01:58.508440 17397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:01:58.512163 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 17276
I20260808 15:01:58.512364 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:01:58.512792 12582 external_mini_cluster.cc:1428] Setting key 54bdde43f1e49ad631bd9876915682d0
I20260808 15:01:58.520208 17397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861: Bootstrap starting.
I20260808 15:01:58.523190 17397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861: Neither blocks nor log segments found. Creating new log.
I20260808 15:01:58.524161 17397 log.cc:824] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861: Log is configured to *not* fsync() on all Append() calls
Aug 08 15:01:58 dist-test-slave-z8x9 krb5kdc[17258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:01:58.526928 17397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861: No bootstrap required, opened a new log
I20260808 15:01:58.534427 17402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:58.514519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46919 (local address 127.12.73.190:38967)
0808 15:01:58.515315 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:58.515326 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:58.515366 (+ 40us) server_negotiation.cc:407] Connection header received
0808 15:01:58.516922 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:58.516942 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:58.517401 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:58.517791 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:58.519237 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:58.520560 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:58.521910 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:58.522555 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:58.522765 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:58.526953 (+ 4188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:58.526961 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:58.526975 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:58.527010 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:58.530346 (+ 3336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:58.531037 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:58.531043 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:58.531048 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:58.531241 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:58.531651 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:58.531658 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:58.531665 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:58.532201 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:58.532543 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:58.532998 (+ 455us) server_negotiation.cc:299] Negotiation successful
0808 15:01:58.533445 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":359,"threads_started":1}
I20260808 15:01:58.534955 17397 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c109ab479647bbbf0ff22495e04861" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38967 } }
I20260808 15:01:58.535403 17397 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:01:58.535518 17397 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62c109ab479647bbbf0ff22495e04861, State: Initialized, Role: FOLLOWER
I20260808 15:01:58.536120 17397 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c109ab479647bbbf0ff22495e04861" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38967 } }
I20260808 15:01:58.536381 17397 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:01:58.536540 17397 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:01:58.536713 17397 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:01:58.538556 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:01:58.539433 17397 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c109ab479647bbbf0ff22495e04861" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38967 } }
I20260808 15:01:58.539932 17397 leader_election.cc:302] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62c109ab479647bbbf0ff22495e04861; no voters:
I20260808 15:01:58.540597 17397 leader_election.cc:288] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:01:58.540706 17406 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:01:58.542363 17406 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [term 1 LEADER]: Becoming Leader. State: Replica: 62c109ab479647bbbf0ff22495e04861, State: Running, Role: LEADER
I20260808 15:01:58.543136 17397 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:01:58.542995 17406 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c109ab479647bbbf0ff22495e04861" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38967 } }
I20260808 15:01:58.547262 17409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62c109ab479647bbbf0ff22495e04861. Latest consensus state: current_term: 1 leader_uuid: "62c109ab479647bbbf0ff22495e04861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c109ab479647bbbf0ff22495e04861" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38967 } } }
I20260808 15:01:58.547710 17409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:58.547247 17407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62c109ab479647bbbf0ff22495e04861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62c109ab479647bbbf0ff22495e04861" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38967 } } }
I20260808 15:01:58.548166 17407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861 [sys.catalog]: This master's current role is: LEADER
I20260808 15:01:58.554862 17429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:01:58.561415 17429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:01:58.571890 17402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:01:58.545309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49105 (local address 127.12.73.190:38967)
0808 15:01:58.545512 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 15:01:58.545522 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:01:58.554004 (+ 8482us) server_negotiation.cc:407] Connection header received
0808 15:01:58.554388 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:01:58.554396 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:01:58.554468 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:01:58.554575 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:01:58.556416 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:58.557231 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:58.559158 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:01:58.559891 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:01:58.559994 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:01:58.563410 (+ 3416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:01:58.563418 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:01:58.563423 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:01:58.563463 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:01:58.567728 (+ 4265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:58.568643 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:58.568651 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:58.568659 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:58.568817 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:01:58.569999 (+ 1182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:01:58.570005 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:01:58.570008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:01:58.570419 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:01:58.570650 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 15:01:58.571287 (+ 637us) server_negotiation.cc:299] Negotiation successful
0808 15:01:58.571523 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 15:01:58.572580 17429 catalog_manager.cc:1347] Generated new cluster ID: 1fb3215cdee44ac8bcc34128b86038f3
I20260808 15:01:58.572705 17429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:01:58.587945 17429 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:01:58.589298 17429 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:01:58.601059 17429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62c109ab479647bbbf0ff22495e04861: Generated new TSK 0
I20260808 15:01:58.601897 17429 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:01:58.609025 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17276
I20260808 15:01:58.610173 17389 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:01:58.703912 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 17276
2026-08-08T15:01:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2358 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:01:58 dist-test-slave-z8x9 krb5kdc[17449](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:01:58 dist-test-slave-z8x9 krb5kdc[17449](info): set up 2 sockets
Aug 08 15:01:58 dist-test-slave-z8x9 krb5kdc[17449](info): commencing operation
krb5kdc: starting...
W20260808 15:02:00.078423 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.332s user 0.003s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:02:00 dist-test-slave-z8x9 krb5kdc[17449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:02:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:02:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 15:02:00.415738 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:41565
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:44563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:41565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:02:00.764037 17468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:02:00.764336 17468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:02:00.764482 17468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:02:00.777766 17468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:02:00.777926 17468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:02:00.778019 17468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:02:00.778116 17468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:02:00.778187 17468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:02:00.796998 17468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:44563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:41565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:41565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:02:00.798842 17468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:02:00.800634 17468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:02:00.822052 17478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:00.822211 17487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:00.822008 17479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:02:00.822908 17468 server_base.cc:1034] running on GCE node
I20260808 15:02:00.823984 17468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:02:00.825979 17468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:02:00.827291 17468 hybrid_clock.cc:648] HybridClock initialized: now 1786201320827211 us; error 53 us; skew 500 ppm
I20260808 15:02:00.827749 17468 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:02:00 dist-test-slave-z8x9 krb5kdc[17449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201320, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:02:00.831663 17468 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:02:00.833122 17468 webserver.cc:460] Webserver started at http://127.12.73.190:43399/ using document root <none> and password file <none>
I20260808 15:02:00.833827 17468 fs_manager.cc:359] Metadata directory not provided
I20260808 15:02:00.833977 17468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:02:00.834304 17468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:02:00.837466 17468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "6315305cc42644e9aec0e8855e1111b4"
format_stamp: "Formatted at 2026-08-08 15:02:00 on dist-test-slave-z8x9"
server_key: "103d8a5ab1e9d206205e13770cae986c"
server_key_iv: "b4f0e56cf48689795c20f0b4daafc1a7"
server_key_version: "encryptionkey@0"
I20260808 15:02:00.838260 17468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "6315305cc42644e9aec0e8855e1111b4"
format_stamp: "Formatted at 2026-08-08 15:02:00 on dist-test-slave-z8x9"
server_key: "103d8a5ab1e9d206205e13770cae986c"
server_key_iv: "b4f0e56cf48689795c20f0b4daafc1a7"
server_key_version: "encryptionkey@0"
I20260808 15:02:00.843680 17468 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 15:02:00.847393 17499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:02:00.848852 17468 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:02:00.849033 17468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "6315305cc42644e9aec0e8855e1111b4"
format_stamp: "Formatted at 2026-08-08 15:02:00 on dist-test-slave-z8x9"
server_key: "103d8a5ab1e9d206205e13770cae986c"
server_key_iv: "b4f0e56cf48689795c20f0b4daafc1a7"
server_key_version: "encryptionkey@0"
I20260808 15:02:00.849303 17468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:02:00.863130 17468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:02:00.867503 17468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:02:00.867794 17468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:02:00.887815 17468 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:41565
I20260808 15:02:00.887907 17589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:41565 every 8 connection(s)
I20260808 15:02:00.889236 17468 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:02:00.889762 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 17468
I20260808 15:02:00.889997 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:02:00.890640 12582 external_mini_cluster.cc:1428] Setting key 3a17a0709bc3f82c0a74395d2684b246
I20260808 15:02:00.893781 17590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:02:00.904021 17594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:00.892443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36539 (local address 127.12.73.190:41565)
0808 15:02:00.893293 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:00.893304 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:00.893344 (+ 40us) server_negotiation.cc:407] Connection header received
0808 15:02:00.895080 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:00.895102 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:00.895517 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:00.895820 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:00.896425 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:00.897808 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:00.899642 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:00.900284 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:00.900410 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:00.901777 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:00.901784 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:00.901796 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:02:00.902299 (+ 503us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:00.902439 (+ 140us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:02:00.902469 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:00.902556 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:00.902806 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 15:02:00.903066 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":376,"threads_started":1}
I20260808 15:02:00.905877 17590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4: Bootstrap starting.
I20260808 15:02:00.907447 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:02:00.908954 17590 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4: Neither blocks nor log segments found. Creating new log.
I20260808 15:02:00.909994 17590 log.cc:824] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4: Log is configured to *not* fsync() on all Append() calls
I20260808 15:02:00.912823 17590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4: No bootstrap required, opened a new log
I20260808 15:02:00.918502 17594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:00.911825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60279 (local address 127.12.73.190:41565)
0808 15:02:00.911997 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:00.912002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:00.912572 (+ 570us) server_negotiation.cc:407] Connection header received
0808 15:02:00.912711 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:00.912716 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:00.912786 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:00.912906 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:00.913488 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:00.914554 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:00.915826 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:00.916564 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:00.916700 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:00.917731 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:00.917739 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:00.917744 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:02:00.917762 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:00.917812 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:02:00.917833 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:00.917930 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:00.918056 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 15:02:00.918150 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 15:02:00.921569 17590 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6315305cc42644e9aec0e8855e1111b4" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41565 } }
I20260808 15:02:00.921945 17590 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:02:00.922056 17590 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6315305cc42644e9aec0e8855e1111b4, State: Initialized, Role: FOLLOWER
I20260808 15:02:00.922580 17590 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6315305cc42644e9aec0e8855e1111b4" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41565 } }
I20260808 15:02:00.922806 17590 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:02:00.922964 17590 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:02:00.923147 17590 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:02:00.925312 17590 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6315305cc42644e9aec0e8855e1111b4" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41565 } }
I20260808 15:02:00.925791 17590 leader_election.cc:302] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6315305cc42644e9aec0e8855e1111b4; no voters:
I20260808 15:02:00.926355 17590 leader_election.cc:288] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:02:00.926479 17612 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:02:00.927162 17612 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6315305cc42644e9aec0e8855e1111b4, State: Running, Role: LEADER
I20260808 15:02:00.927716 17612 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6315305cc42644e9aec0e8855e1111b4" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41565 } }
I20260808 15:02:00.928357 17590 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:02:00.930675 17614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6315305cc42644e9aec0e8855e1111b4. Latest consensus state: current_term: 1 leader_uuid: "6315305cc42644e9aec0e8855e1111b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6315305cc42644e9aec0e8855e1111b4" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41565 } } }
I20260808 15:02:00.930732 17613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6315305cc42644e9aec0e8855e1111b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6315305cc42644e9aec0e8855e1111b4" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 41565 } } }
I20260808 15:02:00.931238 17613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [sys.catalog]: This master's current role is: LEADER
I20260808 15:02:00.931239 17614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4 [sys.catalog]: This master's current role is: LEADER
I20260808 15:02:00.932201 17620 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:02:00.938329 17620 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:02:00.948328 17620 catalog_manager.cc:1347] Generated new cluster ID: 4a891eac2d7b444fb9dae4a23e2bfe13
I20260808 15:02:00.948414 17620 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:02:00.975487 17620 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:02:00.976854 17620 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:02:00.986971 17620 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6315305cc42644e9aec0e8855e1111b4: Generated new TSK 0
I20260808 15:02:00.987804 17620 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:02:00.999357 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17468
W20260808 15:02:01.001036 17582 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:36539
W20260808 15:02:01.001821 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17468: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 15:02:01.001982 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 17468
2026-08-08T15:02:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2300 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:02:01 dist-test-slave-z8x9 krb5kdc[17645](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:02:01 dist-test-slave-z8x9 krb5kdc[17645](info): set up 2 sockets
Aug 08 15:02:01 dist-test-slave-z8x9 krb5kdc[17645](info): commencing operation
krb5kdc: starting...
W20260808 15:02:02.373804 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.327s user 0.003s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:02:02 dist-test-slave-z8x9 krb5kdc[17645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:02:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:02:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 15:02:02.728745 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:40187
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:41507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:40187
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:02:03.080691 17672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:02:03.080982 17672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:02:03.081214 17672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:02:03.088382 17672 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:02:03.088539 17672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:02:03.088639 17672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:02:03.088750 17672 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:02:03.088836 17672 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:02:03.098850 17672 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:41507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:40187
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:40187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:02:03.100205 17672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:02:03.101624 17672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:02:03.114063 17684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:03.114084 17680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:03.114064 17681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:02:03.115089 17672 server_base.cc:1034] running on GCE node
I20260808 15:02:03.115921 17672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:02:03.117547 17672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:02:03.118804 17672 hybrid_clock.cc:648] HybridClock initialized: now 1786201323118758 us; error 36 us; skew 500 ppm
I20260808 15:02:03.119200 17672 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:02:03 dist-test-slave-z8x9 krb5kdc[17645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201323, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:02:03.126973 17672 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:02:03.128774 17672 webserver.cc:460] Webserver started at http://127.12.73.190:37947/ using document root <none> and password file <none>
I20260808 15:02:03.129778 17672 fs_manager.cc:359] Metadata directory not provided
I20260808 15:02:03.129930 17672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:02:03.130334 17672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:02:03.135016 17672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "a6193ccbb4c4408ba872350eced90e0f"
format_stamp: "Formatted at 2026-08-08 15:02:03 on dist-test-slave-z8x9"
server_key: "21982e673cf51398643a80ea2ebfb00a"
server_key_iv: "1210ac731cbba46119c4d3c1b4b5463e"
server_key_version: "encryptionkey@0"
I20260808 15:02:03.135991 17672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "a6193ccbb4c4408ba872350eced90e0f"
format_stamp: "Formatted at 2026-08-08 15:02:03 on dist-test-slave-z8x9"
server_key: "21982e673cf51398643a80ea2ebfb00a"
server_key_iv: "1210ac731cbba46119c4d3c1b4b5463e"
server_key_version: "encryptionkey@0"
I20260808 15:02:03.142673 17672 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 15:02:03.147418 17694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:02:03.149039 17672 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 15:02:03.149309 17672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "a6193ccbb4c4408ba872350eced90e0f"
format_stamp: "Formatted at 2026-08-08 15:02:03 on dist-test-slave-z8x9"
server_key: "21982e673cf51398643a80ea2ebfb00a"
server_key_iv: "1210ac731cbba46119c4d3c1b4b5463e"
server_key_version: "encryptionkey@0"
I20260808 15:02:03.149567 17672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:02:03.157897 17672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:02:03.163887 17672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:02:03.164250 17672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:02:03.187268 17672 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:40187
I20260808 15:02:03.187325 17775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:40187 every 8 connection(s)
I20260808 15:02:03.188616 17672 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:02:03.192478 17776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:02:03.196478 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 17672
I20260808 15:02:03.196658 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:02:03.197103 12582 external_mini_cluster.cc:1428] Setting key 0bb2044d16df39b24e10aac004959a20
I20260808 15:02:03.203609 17776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f: Bootstrap starting.
I20260808 15:02:03.205825 17779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:03.199077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48445 (local address 127.12.73.190:40187)
0808 15:02:03.199906 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:03.199918 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:03.199960 (+ 42us) server_negotiation.cc:407] Connection header received
0808 15:02:03.202323 (+ 2363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:03.202346 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:03.202667 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:03.203048 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:03.204181 (+ 1133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:03.204187 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:03.204199 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:02:03.204214 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:03.204274 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:02:03.204294 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:03.204527 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:03.204658 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 15:02:03.204837 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":357,"threads_started":1}
I20260808 15:02:03.206983 17776 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f: Neither blocks nor log segments found. Creating new log.
I20260808 15:02:03.208364 17776 log.cc:824] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f: Log is configured to *not* fsync() on all Append() calls
I20260808 15:02:03.209796 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:02:03.211302 17776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f: No bootstrap required, opened a new log
I20260808 15:02:03.216681 17779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:03.214233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54149 (local address 127.12.73.190:40187)
0808 15:02:03.214428 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:03.214435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:03.214821 (+ 386us) server_negotiation.cc:407] Connection header received
0808 15:02:03.214954 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:03.214959 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:03.215016 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:03.215119 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:03.216007 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:03.216013 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:03.216018 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 15:02:03.216036 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:03.216081 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 15:02:03.216105 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:03.216226 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:03.216325 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 15:02:03.216386 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 15:02:03.219605 17776 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6193ccbb4c4408ba872350eced90e0f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 40187 } }
I20260808 15:02:03.219944 17776 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 15:02:03.220024 17776 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6193ccbb4c4408ba872350eced90e0f, State: Initialized, Role: FOLLOWER
I20260808 15:02:03.220512 17776 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6193ccbb4c4408ba872350eced90e0f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 40187 } }
I20260808 15:02:03.220821 17776 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 15:02:03.221000 17776 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 15:02:03.221242 17776 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:02:03.223496 17776 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6193ccbb4c4408ba872350eced90e0f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 40187 } }
I20260808 15:02:03.224022 17776 leader_election.cc:302] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6193ccbb4c4408ba872350eced90e0f; no voters:
I20260808 15:02:03.224637 17776 leader_election.cc:288] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 15:02:03.224835 17790 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:02:03.226065 17790 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [term 1 LEADER]: Becoming Leader. State: Replica: a6193ccbb4c4408ba872350eced90e0f, State: Running, Role: LEADER
I20260808 15:02:03.226605 17790 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6193ccbb4c4408ba872350eced90e0f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 40187 } }
I20260808 15:02:03.226948 17776 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:02:03.229287 17793 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6193ccbb4c4408ba872350eced90e0f. Latest consensus state: current_term: 1 leader_uuid: "a6193ccbb4c4408ba872350eced90e0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6193ccbb4c4408ba872350eced90e0f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 40187 } } }
I20260808 15:02:03.229691 17793 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [sys.catalog]: This master's current role is: LEADER
I20260808 15:02:03.229468 17792 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6193ccbb4c4408ba872350eced90e0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6193ccbb4c4408ba872350eced90e0f" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 40187 } } }
I20260808 15:02:03.229871 17792 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f [sys.catalog]: This master's current role is: LEADER
I20260808 15:02:03.232748 17806 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:02:03.237833 17806 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:02:03.246294 17806 catalog_manager.cc:1347] Generated new cluster ID: 6e877fa9d1894075982747a139cff4b1
I20260808 15:02:03.246414 17806 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:02:03.258157 17806 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:02:03.258610 17806 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:02:03.266057 17806 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6193ccbb4c4408ba872350eced90e0f: Generated new TSK 0
I20260808 15:02:03.266912 17806 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:02:03.276861 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17672
W20260808 15:02:03.278198 17771 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48445
W20260808 15:02:03.278961 12582 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17672: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 15:02:03.279134 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 17672
2026-08-08T15:02:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2277 ms)
[----------] 18 tests from AuthTokenIssuingTest (41396 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:02:03 dist-test-slave-z8x9 krb5kdc[17830](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:02:03 dist-test-slave-z8x9 krb5kdc[17830](info): set up 2 sockets
Aug 08 15:02:03 dist-test-slave-z8x9 krb5kdc[17830](info): commencing operation
krb5kdc: starting...
W20260808 15:02:04.658169 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.333s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:02:04 dist-test-slave-z8x9 krb5kdc[17830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:02:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:02:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 15:02:05.004442 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34419
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:33745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:34419,127.12.73.189:39535,127.12.73.188:46011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:02:05.347934 17852 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 15:02:05.348472 17852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:02:05.348603 17852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:02:05.348753 17852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:02:05.356678 17852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:02:05.356782 17852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:02:05.356851 17852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:02:05.356910 17852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:02:05.356974 17852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:02:05.367394 17852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:33745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:34419,127.12.73.189:39535,127.12.73.188:46011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:34419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:02:05.368732 17852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:02:05.370116 17852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:02:05.381719 17859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:05.381814 17862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:05.381846 17860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:02:05.382858 17852 server_base.cc:1034] running on GCE node
I20260808 15:02:05.383584 17852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:02:05.384883 17852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:02:05.386099 17852 hybrid_clock.cc:648] HybridClock initialized: now 1786201325386020 us; error 57 us; skew 500 ppm
I20260808 15:02:05.386456 17852 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:02:05 dist-test-slave-z8x9 krb5kdc[17830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201325, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:02:05.389664 17852 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:02:05.391188 17852 webserver.cc:460] Webserver started at http://127.12.73.190:35411/ using document root <none> and password file <none>
I20260808 15:02:05.391860 17852 fs_manager.cc:359] Metadata directory not provided
I20260808 15:02:05.391975 17852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:02:05.392295 17852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:02:05.395292 17852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a"
format_stamp: "Formatted at 2026-08-08 15:02:05 on dist-test-slave-z8x9"
server_key: "c79651915dc43b7baeed5b93e422a702"
server_key_iv: "1ee9ab3b21ff594c55a83ddf73bc9fa8"
server_key_version: "encryptionkey@0"
I20260808 15:02:05.396077 17852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a"
format_stamp: "Formatted at 2026-08-08 15:02:05 on dist-test-slave-z8x9"
server_key: "c79651915dc43b7baeed5b93e422a702"
server_key_iv: "1ee9ab3b21ff594c55a83ddf73bc9fa8"
server_key_version: "encryptionkey@0"
I20260808 15:02:05.401422 17852 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 15:02:05.404691 17878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:02:05.406044 17852 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:02:05.406229 17852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a"
format_stamp: "Formatted at 2026-08-08 15:02:05 on dist-test-slave-z8x9"
server_key: "c79651915dc43b7baeed5b93e422a702"
server_key_iv: "1ee9ab3b21ff594c55a83ddf73bc9fa8"
server_key_version: "encryptionkey@0"
I20260808 15:02:05.406443 17852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:02:05.420114 17852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:02:05.423890 17852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:02:05.424183 17852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:02:05.443071 17852 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:34419
I20260808 15:02:05.443104 17964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:34419 every 8 connection(s)
I20260808 15:02:05.444386 17852 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:02:05.447989 17965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:02:05.448832 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 17852
I20260808 15:02:05.449047 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:02:05.449731 12582 external_mini_cluster.cc:1428] Setting key edbc7bbb77ee115184c771b9ce088d28
I20260808 15:02:05.454986 17965 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:02:05 dist-test-slave-z8x9 krb5kdc[17830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201325, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:02:05.479542 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.458034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34419 (local address 127.0.0.1:38092)
0808 15:02:05.458924 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:05.458973 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:05.461725 (+ 2752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:05.462715 (+ 990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:05.462725 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:05.463531 (+ 806us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:05.464043 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:05.464070 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:05.465687 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:05.465694 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:05.466851 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:05.466863 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:05.468261 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:05.468266 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:05.468453 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:05.469129 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:05.469151 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:05.471285 (+ 2134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:05.475780 (+ 4495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:05.475790 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:05.475797 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:05.476206 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:05.476699 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:05.476702 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:05.476704 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:05.476849 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:05.477839 (+ 990us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:05.477845 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:05.478012 (+ 167us) client_negotiation.cc:769] Sending connection context
0808 15:02:05.478211 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 15:02:05.478565 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":47,"spinlock_wait_cycles":3456,"thread_start_us":358,"threads_started":1}
I20260808 15:02:05.479637 17969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.458034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38092 (local address 127.12.73.190:34419)
0808 15:02:05.459838 (+ 1804us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:05.459844 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:05.459886 (+ 42us) server_negotiation.cc:407] Connection header received
0808 15:02:05.462129 (+ 2243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:05.462147 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:05.462429 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:05.462627 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:05.464257 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:05.465526 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:05.467016 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:05.468037 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:05.468255 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:05.471531 (+ 3276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:05.471543 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:05.471560 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:05.471601 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:05.475580 (+ 3979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:05.476349 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:05.476361 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:05.476367 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:05.476587 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:05.476959 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:05.476967 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:05.476973 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:05.477696 (+ 723us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:05.477880 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:05.478401 (+ 521us) server_negotiation.cc:299] Negotiation successful
0808 15:02:05.478740 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":1622,"spinlock_wait_cycles":28800,"thread_start_us":1376,"threads_started":1}
I20260808 15:02:05.482489 17965 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:02:05.483609 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.483243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45704)
0808 15:02:05.483412 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:05.483514 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 15:02:05.483904 17879 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.73.189@KRBTEST.COM; defaulting to no policy
I20260808 15:02:05.485582 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.485201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45718)
0808 15:02:05.485361 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:05.485442 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 15:02:05.485833 17965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:39535: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.189.keytab.
Entry for principal kudu/127.12.73.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.189.keytab.
I20260808 15:02:05.526736 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.189:39535
--webserver_interface=127.12.73.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.189.keytab
--principal=kudu/127.12.73.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:33745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:34419,127.12.73.189:39535,127.12.73.188:46011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:02:05.535214 17965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } attempt: 1
I20260808 15:02:05.536537 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.535933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45720)
0808 15:02:05.536189 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:05.536348 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 15:02:05.537819 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.537328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45734)
0808 15:02:05.537509 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:05.537605 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 15:02:05.538061 17965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:39535: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
I20260808 15:02:05.606397 17965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } attempt: 2
I20260808 15:02:05.607637 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.607167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45750)
0808 15:02:05.607404 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:05.607505 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 15:02:05.608634 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.608265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45766)
0808 15:02:05.608431 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:05.608502 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 15:02:05.608821 17965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:39535: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
I20260808 15:02:05.700151 17965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } attempt: 3
I20260808 15:02:05.701350 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.700846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45782)
0808 15:02:05.701048 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:05.701149 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 15:02:05.702323 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.701983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45786)
0808 15:02:05.702123 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:05.702198 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 15:02:05.702500 17965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:39535: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
I20260808 15:02:05.845854 17965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } attempt: 4
I20260808 15:02:05.847051 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.846504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45790)
0808 15:02:05.846824 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:05.846917 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260808 15:02:05.848040 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.847675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45796)
0808 15:02:05.847817 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:05.847921 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 15:02:05.848248 17965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:39535: Network error: Client connection negotiation failed: client connection to 127.12.73.189:39535: connect: Connection refused (error 111)
W20260808 15:02:05.870630 17975 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 15:02:05.870915 17975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:02:05.870996 17975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:02:05.871181 17975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:02:05.878248 17975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:02:05.878332 17975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:02:05.878420 17975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:02:05.878511 17975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:02:05.878619 17975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:02:05.888058 17975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:33745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:34419,127.12.73.189:39535,127.12.73.188:46011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.189.keytab
--principal=kudu/127.12.73.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.189:39535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.73.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:02:05.889439 17975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:02:05.890738 17975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:02:05.902529 17986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:05.902616 17983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:05.902563 17984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:02:05.903515 17975 server_base.cc:1034] running on GCE node
I20260808 15:02:05.904486 17975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:02:05.906006 17975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:02:05.907325 17975 hybrid_clock.cc:648] HybridClock initialized: now 1786201325907231 us; error 58 us; skew 500 ppm
I20260808 15:02:05.907696 17975 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:02:05 dist-test-slave-z8x9 krb5kdc[17830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201325, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:02:05.911262 17975 init.cc:377] Logged in from keytab as kudu/127.12.73.189@KRBTEST.COM (short username kudu)
I20260808 15:02:05.912753 17975 webserver.cc:460] Webserver started at http://127.12.73.189:46663/ using document root <none> and password file <none>
I20260808 15:02:05.913545 17975 fs_manager.cc:359] Metadata directory not provided
I20260808 15:02:05.913681 17975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:02:05.914005 17975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:02:05.916889 17975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/data/instance:
uuid: "273ccd9e4d5b4208b5712914cca2b1ac"
format_stamp: "Formatted at 2026-08-08 15:02:05 on dist-test-slave-z8x9"
server_key: "3c512888ba91e2b127d18eac58a6dbad"
server_key_iv: "27cc51679957222bedf775ebc6ff5602"
server_key_version: "encryptionkey@0"
I20260808 15:02:05.917757 17975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/wal/instance:
uuid: "273ccd9e4d5b4208b5712914cca2b1ac"
format_stamp: "Formatted at 2026-08-08 15:02:05 on dist-test-slave-z8x9"
server_key: "3c512888ba91e2b127d18eac58a6dbad"
server_key_iv: "27cc51679957222bedf775ebc6ff5602"
server_key_version: "encryptionkey@0"
I20260808 15:02:05.922716 17975 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 15:02:05.926239 17998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:02:05.927593 17975 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 15:02:05.927886 17975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/wal
uuid: "273ccd9e4d5b4208b5712914cca2b1ac"
format_stamp: "Formatted at 2026-08-08 15:02:05 on dist-test-slave-z8x9"
server_key: "3c512888ba91e2b127d18eac58a6dbad"
server_key_iv: "27cc51679957222bedf775ebc6ff5602"
server_key_version: "encryptionkey@0"
I20260808 15:02:05.928119 17975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:02:05.941022 17975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:02:05.944875 17975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:02:05.945147 17975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:02:05.964342 17975 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.189:39535
I20260808 15:02:05.964371 18076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.189:39535 every 8 connection(s)
I20260808 15:02:05.965751 17975 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
I20260808 15:02:05.969429 18077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:02:05.970639 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 17975
I20260808 15:02:05.970829 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-1/wal/instance
I20260808 15:02:05.971452 12582 external_mini_cluster.cc:1428] Setting key 167b02a290bbc89b0dfba486728cf187
I20260808 15:02:05.979061 18077 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:02:05 dist-test-slave-z8x9 krb5kdc[17830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201325, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.189@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:02:06.002738 18081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.982341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38098 (local address 127.12.73.190:34419)
0808 15:02:05.982832 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:05.982839 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:05.983878 (+ 1039us) server_negotiation.cc:407] Connection header received
0808 15:02:05.986768 (+ 2890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:05.986773 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:05.986839 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:05.986927 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:05.988469 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:05.989705 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:05.991160 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:05.991893 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:05.992026 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:05.995463 (+ 3437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:05.995473 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:05.995480 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:05.995526 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:05.999363 (+ 3837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.000079 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.000086 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.000092 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.000247 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.000655 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.000663 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.000669 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.001104 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.001296 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.001964 (+ 668us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.002224 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":236,"threads_started":1}
I20260808 15:02:06.003293 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:05.982909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34419 (local address 127.0.0.1:38098)
0808 15:02:05.983700 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:05.983748 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:05.986459 (+ 2711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:05.987196 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:05.987213 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:05.987721 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:05.988253 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:05.988269 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:05.989852 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:05.989856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:05.991014 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:05.991025 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:05.992103 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:05.992108 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:05.992298 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:05.993017 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:05.993039 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:05.995231 (+ 2192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:05.999509 (+ 4278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:05.999515 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:05.999527 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:05.999954 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.000354 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.000357 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.000360 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.000531 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.001265 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:06.001271 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:06.001588 (+ 317us) client_negotiation.cc:769] Sending connection context
0808 15:02:06.001817 (+ 229us) client_negotiation.cc:240] Negotiation successful
0808 15:02:06.002187 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":301,"threads_started":1}
I20260808 15:02:06.005079 18077 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.73.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.188@KRBTEST.COM" created.
Aug 08 15:02:06 dist-test-slave-z8x9 krb5kdc[17830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201325, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.189@KRBTEST.COM for kudu/127.12.73.189@KRBTEST.COM
I20260808 15:02:06.021054 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.005935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45808)
0808 15:02:06.006171 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.006194 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:06.006297 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:06.007290 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:06.007296 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:06.007841 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:06.008028 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.008038 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.009528 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.009532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.010511 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.010523 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.011653 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.011658 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.011790 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.012424 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:06.012441 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:06.014438 (+ 1997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:06.018752 (+ 4314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.018756 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.018759 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.019110 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.019526 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.019530 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.019532 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.019660 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.020383 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:06.020386 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:06.020496 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 15:02:06.020600 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 15:02:06.020795 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 15:02:06.021764 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.006193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45808 (local address 127.12.73.189:39535)
0808 15:02:06.006881 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.006887 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.006912 (+ 25us) server_negotiation.cc:407] Connection header received
0808 15:02:06.006956 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.006962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.007114 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.007224 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.008194 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.009389 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.010685 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.011477 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.011618 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.014656 (+ 3038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.014671 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.014689 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.014728 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.018621 (+ 3893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.019237 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.019248 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.019255 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.019417 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.019781 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.019789 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.019794 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.020265 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.020479 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.020770 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.021060 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":399,"threads_started":1}
I20260808 15:02:06.024075 18077 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:02:06.025482 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.024883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:52928)
0808 15:02:06.025083 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.025298 (+ 215us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 15:02:06.025801 18001 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
I20260808 15:02:06.027498 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.027154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:52932)
0808 15:02:06.027332 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.027397 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260808 15:02:06.027711 18077 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:46011: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.188.keytab.
Entry for principal kudu/127.12.73.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.188.keytab.
I20260808 15:02:06.052760 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.188:46011
--webserver_interface=127.12.73.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.188.keytab
--principal=kudu/127.12.73.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:33745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:34419,127.12.73.189:39535,127.12.73.188:46011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:02:06.077049 18077 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } attempt: 1
I20260808 15:02:06.078469 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.077853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:52942)
0808 15:02:06.078106 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.078248 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 15:02:06.079617 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.079143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:52952)
0808 15:02:06.079350 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.079457 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 15:02:06.079893 18077 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:46011: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
I20260808 15:02:06.147621 17965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } attempt: 5
I20260808 15:02:06.148141 18077 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } attempt: 2
I20260808 15:02:06.149326 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.148796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:52962)
0808 15:02:06.148985 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.149092 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 15:02:06.150490 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.150060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:52964)
0808 15:02:06.150220 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.150312 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 15:02:06.151114 18077 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:46011: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Aug 08 15:02:06 dist-test-slave-z8x9 krb5kdc[17830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201325, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for kudu/127.12.73.189@KRBTEST.COM
I20260808 15:02:06.162019 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.148523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45814 (local address 127.12.73.189:39535)
0808 15:02:06.148726 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.148733 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.148840 (+ 107us) server_negotiation.cc:407] Connection header received
0808 15:02:06.149029 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.149035 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.149141 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.149275 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.150232 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.151171 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.152353 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.152794 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.152931 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.156557 (+ 3626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.156562 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.156565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.156622 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.159304 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.160182 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.160186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.160188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.160307 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.160703 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.160706 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.160708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.160981 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.161158 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.161623 (+ 465us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.161787 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 15:02:06.162175 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.148431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45814)
0808 15:02:06.148725 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.148747 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:06.148898 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:06.149323 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:06.149328 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:06.149814 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:06.150090 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.150106 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.151345 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.151351 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.152207 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.152218 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.152957 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.152963 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.153214 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.153886 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:06.153903 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:06.156368 (+ 2465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:06.159459 (+ 3091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.159468 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.159473 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.160063 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.160417 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.160422 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.160426 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.160597 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.161137 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:06.161142 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:06.161349 (+ 207us) client_negotiation.cc:769] Sending connection context
0808 15:02:06.161545 (+ 196us) client_negotiation.cc:240] Negotiation successful
0808 15:02:06.161846 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185}
I20260808 15:02:06.163373 17965 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:02:06.164582 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.164225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:52976)
0808 15:02:06.164389 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.164460 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 15:02:06.165489 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.165156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:52992)
0808 15:02:06.165312 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.165399 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 15:02:06.165714 17965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:46011: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
I20260808 15:02:06.217013 17965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } attempt: 1
I20260808 15:02:06.218289 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.217801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53000)
0808 15:02:06.217996 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.218091 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 15:02:06.219287 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.218950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53004)
0808 15:02:06.219108 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.219181 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 15:02:06.219499 17965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:46011: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
I20260808 15:02:06.242379 18077 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } attempt: 3
I20260808 15:02:06.243645 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.243082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53010)
0808 15:02:06.243328 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.243454 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 15:02:06.244747 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.244264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53020)
0808 15:02:06.244499 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.244594 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
W20260808 15:02:06.244983 18077 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:46011: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
I20260808 15:02:06.287796 17965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } attempt: 2
I20260808 15:02:06.289033 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.288521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53030)
0808 15:02:06.288769 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.288864 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 15:02:06.290140 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.289840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53042)
0808 15:02:06.289964 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.290028 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 15:02:06.290426 17965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:46011: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
I20260808 15:02:06.388224 18077 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } attempt: 4
I20260808 15:02:06.389474 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.388878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53052)
0808 15:02:06.389133 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.389279 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 15:02:06.390654 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.390137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53064)
0808 15:02:06.390401 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.390499 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
W20260808 15:02:06.390902 18077 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:46011: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
I20260808 15:02:06.396636 17965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } attempt: 3
I20260808 15:02:06.397710 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.397282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53078)
0808 15:02:06.397461 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.397546 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 15:02:06.398732 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.398364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53086)
0808 15:02:06.398550 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.398628 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
W20260808 15:02:06.398963 17965 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:46011: Network error: Client connection negotiation failed: client connection to 127.12.73.188:46011: connect: Connection refused (error 111)
W20260808 15:02:06.403090 18089 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 15:02:06.403458 18089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:02:06.403565 18089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:02:06.403697 18089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:02:06.411070 18089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:02:06.411201 18089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:02:06.411320 18089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:02:06.411407 18089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:02:06.411520 18089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:02:06.421721 18089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:33745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:34419,127.12.73.189:39535,127.12.73.188:46011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.188.keytab
--principal=kudu/127.12.73.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.188:46011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.73.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:02:06.423015 18089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:02:06.424451 18089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:02:06.436724 18098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:06.436908 18097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:06.436825 18101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:02:06.437963 18089 server_base.cc:1034] running on GCE node
I20260808 15:02:06.438733 18089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:02:06.440054 18089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:02:06.441296 18089 hybrid_clock.cc:648] HybridClock initialized: now 1786201326441230 us; error 44 us; skew 500 ppm
I20260808 15:02:06.441632 18089 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:02:06 dist-test-slave-z8x9 krb5kdc[17830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201326, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:02:06.444921 18089 init.cc:377] Logged in from keytab as kudu/127.12.73.188@KRBTEST.COM (short username kudu)
I20260808 15:02:06.446458 18089 webserver.cc:460] Webserver started at http://127.12.73.188:34347/ using document root <none> and password file <none>
I20260808 15:02:06.447170 18089 fs_manager.cc:359] Metadata directory not provided
I20260808 15:02:06.447327 18089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:02:06.447650 18089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:02:06.450556 18089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/data/instance:
uuid: "6c0539d3354f45b8ba112469ad2ef685"
format_stamp: "Formatted at 2026-08-08 15:02:06 on dist-test-slave-z8x9"
server_key: "a70dcb2a62b0c6fc30c41b8159acf697"
server_key_iv: "082920e168201d82d0ed0e4b224e8235"
server_key_version: "encryptionkey@0"
I20260808 15:02:06.451356 18089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/wal/instance:
uuid: "6c0539d3354f45b8ba112469ad2ef685"
format_stamp: "Formatted at 2026-08-08 15:02:06 on dist-test-slave-z8x9"
server_key: "a70dcb2a62b0c6fc30c41b8159acf697"
server_key_iv: "082920e168201d82d0ed0e4b224e8235"
server_key_version: "encryptionkey@0"
I20260808 15:02:06.456380 18089 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 15:02:06.459779 18117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:02:06.461063 18089 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 15:02:06.461270 18089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/wal
uuid: "6c0539d3354f45b8ba112469ad2ef685"
format_stamp: "Formatted at 2026-08-08 15:02:06 on dist-test-slave-z8x9"
server_key: "a70dcb2a62b0c6fc30c41b8159acf697"
server_key_iv: "082920e168201d82d0ed0e4b224e8235"
server_key_version: "encryptionkey@0"
I20260808 15:02:06.461494 18089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:02:06.493251 18089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:02:06.497418 18089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:02:06.497717 18089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:02:06.516494 18089 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.188:46011
I20260808 15:02:06.516527 18199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.188:46011 every 8 connection(s)
I20260808 15:02:06.517951 18089 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
I20260808 15:02:06.521544 18202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:02:06.527330 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 18089
I20260808 15:02:06.527550 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200952883082-12582-0/minicluster-data/master-2/wal/instance
I20260808 15:02:06.528108 12582 external_mini_cluster.cc:1428] Setting key 8d27e100489aecd61aee31ab7386dcbd
I20260808 15:02:06.528262 18202 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:02:06 dist-test-slave-z8x9 krb5kdc[17830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201326, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.188@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
Aug 08 15:02:06 dist-test-slave-z8x9 krb5kdc[17830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.188@KRBTEST.COM
I20260808 15:02:06.548094 18208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.531323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38102 (local address 127.12.73.190:34419)
0808 15:02:06.531850 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.531857 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.532484 (+ 627us) server_negotiation.cc:407] Connection header received
0808 15:02:06.533644 (+ 1160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.533652 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.533732 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.533849 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.535139 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.535841 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.537449 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.537860 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.537988 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.541877 (+ 3889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.541882 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.541885 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.541917 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.544924 (+ 3007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.545793 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.545799 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.545802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.545938 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.546395 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.546398 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.546400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.546659 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.546813 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.547493 (+ 680us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.547704 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":244,"threads_started":1}
I20260808 15:02:06.549121 18213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.531388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:34419 (local address 127.0.0.1:38102)
0808 15:02:06.532339 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.532374 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:06.533389 (+ 1015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:06.533926 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:06.533934 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:06.534591 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:06.534971 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.534988 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.536007 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.536011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.537302 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.537314 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.538098 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.538105 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.538395 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.539102 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:06.539124 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:06.541677 (+ 2553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:06.545059 (+ 3382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.545070 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.545081 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.545661 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.546049 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.546054 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.546058 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.546262 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.546791 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:06.546800 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:06.547123 (+ 323us) client_negotiation.cc:769] Sending connection context
0808 15:02:06.547378 (+ 255us) client_negotiation.cc:240] Negotiation successful
0808 15:02:06.547867 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"mutex_wait_us":45,"thread_start_us":389,"threads_started":1}
I20260808 15:02:06.549139 18207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.530138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53092 (local address 127.12.73.188:46011)
0808 15:02:06.530960 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.530976 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.531022 (+ 46us) server_negotiation.cc:407] Connection header received
0808 15:02:06.533383 (+ 2361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.533404 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.533632 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.533860 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.535393 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.536606 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.537993 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.538546 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.538688 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.543155 (+ 4467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.543163 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.543175 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.543216 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.546013 (+ 2797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.546693 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.546700 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.546703 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.546834 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.547247 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.547250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.547252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.547562 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.547900 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.548213 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.548465 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":597,"thread_start_us":340,"threads_started":1}
I20260808 15:02:06.550822 18202 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:02:06 dist-test-slave-z8x9 krb5kdc[17830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201326, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.188@KRBTEST.COM for kudu/127.12.73.189@KRBTEST.COM
Aug 08 15:02:06 dist-test-slave-z8x9 krb5kdc[17830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:02:06.565234 18213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.551680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:39535 (local address 127.0.0.1:45830)
0808 15:02:06.551870 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.551891 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:06.552208 (+ 317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:06.552583 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:06.552600 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:06.552970 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:06.553097 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.553104 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.554299 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.554305 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.555421 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.555432 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.556409 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.556414 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.556620 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.557257 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:06.557278 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:06.559423 (+ 2145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:06.562493 (+ 3070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.562500 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.562505 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.563026 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.563411 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.563416 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.563420 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.563598 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.564163 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:06.564171 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:06.564367 (+ 196us) client_negotiation.cc:769] Sending connection context
0808 15:02:06.564572 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 15:02:06.564774 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 15:02:06.565326 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.551828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45830 (local address 127.12.73.189:39535)
0808 15:02:06.551987 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.551996 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.552017 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:02:06.552366 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.552370 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.552431 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.552541 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.553273 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.554158 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.555575 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.556271 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.556390 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.559609 (+ 3219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.559614 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.559618 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.559647 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.562362 (+ 2715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.563142 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.563146 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.563149 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.563288 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.563715 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.563719 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.563721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.564030 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.564149 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.564689 (+ 540us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.564913 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 15:02:06.566226 18202 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:02:06.567620 18208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.552110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38114 (local address 127.12.73.190:34419)
0808 15:02:06.552271 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.552278 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.552296 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:02:06.552361 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.552364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.552422 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.552491 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.553876 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.554832 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.556388 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.556971 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.557148 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.561289 (+ 4141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.561296 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.561302 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.561349 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.564301 (+ 2952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.565053 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.565058 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.565062 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.565235 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.566087 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.566095 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.566098 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.566442 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.566756 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.567053 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.567283 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 15:02:06 dist-test-slave-z8x9 krb5kdc[17830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201326, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.188@KRBTEST.COM for kudu/127.12.73.188@KRBTEST.COM
I20260808 15:02:06.576195 17965 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } attempt: 4
Aug 08 15:02:06 dist-test-slave-z8x9 krb5kdc[17830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.189@KRBTEST.COM
I20260808 15:02:06.582587 18213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.567056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53096)
0808 15:02:06.567288 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.567305 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:06.567444 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:06.568094 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:06.568099 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:06.568561 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:06.568739 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.568749 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.570063 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.570068 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.571518 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.571530 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.572423 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.572426 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.572713 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.573266 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:06.573288 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:06.575755 (+ 2467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:06.579904 (+ 4149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.579912 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.579916 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.580326 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.580723 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.580729 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.580734 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.580908 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.581593 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:06.581601 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:06.581780 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 15:02:06.581950 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 15:02:06.582273 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":37}
I20260808 15:02:06.583356 18207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.566958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53096 (local address 127.12.73.188:46011)
0808 15:02:06.567128 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.567135 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.567373 (+ 238us) server_negotiation.cc:407] Connection header received
0808 15:02:06.567571 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.567575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.567629 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.567743 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.568887 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.569932 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.571648 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.572285 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.572412 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.575934 (+ 3522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.575940 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.575943 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.575969 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.579773 (+ 3804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.580423 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.580429 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.580432 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.580596 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.581040 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.581046 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.581051 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.581456 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.581613 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.582906 (+ 1293us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.583090 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":63}
Aug 08 15:02:06 dist-test-slave-z8x9 krb5kdc[17830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201325, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for kudu/127.12.73.188@KRBTEST.COM
I20260808 15:02:06.587067 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.569497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45842 (local address 127.12.73.189:39535)
0808 15:02:06.569671 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.569676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.569701 (+ 25us) server_negotiation.cc:407] Connection header received
0808 15:02:06.569744 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.569749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.569810 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.569902 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.571407 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.572425 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.574176 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.574678 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.574827 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.580470 (+ 5643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.580477 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.580484 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.580524 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.583947 (+ 3423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.584748 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.584753 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.584756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.584937 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.585469 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.585474 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.585478 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.585863 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.586134 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.586449 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.586687 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 15:02:06.589803 18202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685: Bootstrap starting.
I20260808 15:02:06.592069 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:02:06.593814 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.576852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53108)
0808 15:02:06.577020 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.577045 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:06.577163 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:06.577838 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:06.577846 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:06.578332 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:06.578553 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.578569 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.580357 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.580365 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.581776 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.581790 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.582808 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.582816 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.583039 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.583758 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:06.583774 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:06.586405 (+ 2631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:06.590786 (+ 4381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.590790 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.590795 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.591472 (+ 677us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.591905 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.591912 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.591916 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.592089 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.592814 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:06.592821 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:06.593002 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 15:02:06.593146 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 15:02:06.593449 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 15:02:06.593937 18202 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685: Neither blocks nor log segments found. Creating new log.
I20260808 15:02:06.593993 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.576929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53108 (local address 127.12.73.188:46011)
0808 15:02:06.577589 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.577593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.577610 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:02:06.577644 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.577647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.577693 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.577808 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.578787 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.580198 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.581923 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.582611 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.583329 (+ 718us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.586665 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.586675 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.586679 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.586717 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.590602 (+ 3885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.591606 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.591612 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.591615 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.591778 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.592234 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.592239 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.592242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.592608 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.592812 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.593307 (+ 495us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.593510 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":371,"threads_started":1}
I20260808 15:02:06.595342 18202 log.cc:824] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685: Log is configured to *not* fsync() on all Append() calls
I20260808 15:02:06.598225 18202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685: No bootstrap required, opened a new log
I20260808 15:02:06.598474 17965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a: Bootstrap starting.
I20260808 15:02:06.602613 17965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a: Neither blocks nor log segments found. Creating new log.
I20260808 15:02:06.599082 17920 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38114
I20260808 15:02:06.604033 17965 log.cc:824] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a: Log is configured to *not* fsync() on all Append() calls
I20260808 15:02:06.605953 18202 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } }
I20260808 15:02:06.606287 18202 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0539d3354f45b8ba112469ad2ef685, State: Initialized, Role: FOLLOWER
I20260808 15:02:06.606969 17965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a: No bootstrap required, opened a new log
I20260808 15:02:06.606796 18202 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } }
I20260808 15:02:06.607767 18217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } } }
I20260808 15:02:06.608215 18217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:06.608860 18202 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:02:06.614535 17965 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } }
I20260808 15:02:06.614899 17965 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a, State: Initialized, Role: FOLLOWER
I20260808 15:02:06.615383 17965 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } }
I20260808 15:02:06.616365 18224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } } }
I20260808 15:02:06.616771 18224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:06.617496 17965 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:02:06.617697 17920 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 15:02:06.617944 17920 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:02:06.621137 17920 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } }
I20260808 15:02:06.624576 17920 leader_election.cc:288] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [CANDIDATE]: Term 1 election: Requested vote from peers 273ccd9e4d5b4208b5712914cca2b1ac (127.12.73.189:39535), 6c0539d3354f45b8ba112469ad2ef685 (127.12.73.188:46011)
I20260808 15:02:06.625007 18160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6c0539d3354f45b8ba112469ad2ef685"
I20260808 15:02:06.625857 18160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:02:06.639058 18160 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a in term 1.
I20260808 15:02:06.639920 17880 leader_election.cc:302] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a, 6c0539d3354f45b8ba112469ad2ef685; no voters:
I20260808 15:02:06.640578 18224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:02:06.645246 18224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a, State: Running, Role: LEADER
I20260808 15:02:06.645821 18224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } }
W20260808 15:02:06.650556 18252 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:02:06.658337 18252 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260808 15:02:06.659149 18267 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 15:02:06.659296 18267 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260808 15:02:06.676890 17885 tablet.cc:2369] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:02:06.676956 18208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.647716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38116 (local address 127.12.73.190:34419)
0808 15:02:06.648086 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.648095 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.648115 (+ 20us) server_negotiation.cc:407] Connection header received
0808 15:02:06.648169 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.648173 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.648244 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.648356 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.651364 (+ 3008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.652979 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.657033 (+ 4054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.657738 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.657845 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.669388 (+ 11543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.669396 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.669400 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.669442 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.673356 (+ 3914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.674262 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.674269 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.674273 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.674454 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.674952 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.674958 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.674967 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.675362 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.675639 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.676228 (+ 589us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.676483 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259}
I20260808 15:02:06.677899 18262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a. Latest consensus state: current_term: 1 leader_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } } }
I20260808 15:02:06.678359 18262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [sys.catalog]: This master's current role is: LEADER
I20260808 15:02:06.635730 17852 master_runner.cc:186] Error getting master registration for 127.12.73.189:39535: OK, instance_id { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" instance_seqno: 1786201325958988 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 15:02:06.686535 17852 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:02:06.690011 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.647902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45854 (local address 127.12.73.189:39535)
0808 15:02:06.648609 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.648617 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.648638 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:02:06.648699 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.648706 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.648772 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.648873 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.659064 (+ 10191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.660325 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.663942 (+ 3617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.664634 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.664750 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.677819 (+ 13069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.677826 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.677832 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.677900 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.683196 (+ 5296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.686358 (+ 3162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.686364 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.686370 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.686525 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.687380 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.687385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.687389 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.687775 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.688025 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.689373 (+ 1348us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.689614 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567}
I20260808 15:02:06.690089 18077 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } attempt: 5
I20260808 15:02:06.690863 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.647992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53114 (local address 127.12.73.188:46011)
0808 15:02:06.648183 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.648202 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.659821 (+ 11619us) server_negotiation.cc:407] Connection header received
0808 15:02:06.660255 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.660263 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.660403 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.660496 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.666430 (+ 5934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.668317 (+ 1887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.671342 (+ 3025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.672083 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.672184 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.679054 (+ 6870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.679063 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.679068 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.679118 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.685006 (+ 5888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.686665 (+ 1659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.686672 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.686682 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.686858 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.688105 (+ 1247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.688110 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.688113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.688507 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.688745 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.689600 (+ 855us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.690012 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 15:02:06.686133 18089 master_runner.cc:186] Error getting master registration for 127.12.73.189:39535: OK, instance_id { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" instance_seqno: 1786201325958988 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 15:02:06.696450 18089 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:02:06.697923 18276 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 15:02:06.700285 18276 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 15:02:06 dist-test-slave-z8x9 krb5kdc[17830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201325, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.189@KRBTEST.COM for kudu/127.12.73.188@KRBTEST.COM
I20260808 15:02:06.710000 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.690675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:46011 (local address 127.0.0.1:53124)
0808 15:02:06.691023 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:06.691042 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:06.691145 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:06.692215 (+ 1070us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:06.692221 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:06.692697 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:06.692912 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.692924 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.694758 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.694764 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.696224 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:06.696240 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.697638 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.697644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:06.697956 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.698723 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:06.698746 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:06.702369 (+ 3623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:06.706821 (+ 4452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.706827 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.706831 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.707364 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.707839 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:06.707845 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:06.707848 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:06.708017 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:06.708802 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:06.708807 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:06.708975 (+ 168us) client_negotiation.cc:769] Sending connection context
0808 15:02:06.709207 (+ 232us) client_negotiation.cc:240] Negotiation successful
0808 15:02:06.709599 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225}
I20260808 15:02:06.711426 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:06.691335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53124 (local address 127.12.73.188:46011)
0808 15:02:06.691894 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.691900 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.691917 (+ 17us) server_negotiation.cc:407] Connection header received
0808 15:02:06.691972 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.691977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.692051 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.693070 (+ 1019us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.693227 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.694620 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.696595 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:06.697453 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:06.697627 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:06.702610 (+ 4983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:06.702616 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:06.702621 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:06.702658 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:06.706647 (+ 3989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.707515 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.707521 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.707524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.707689 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:06.708152 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:06.708158 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:06.708161 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:06.708526 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:06.708719 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:06.710822 (+ 2103us) server_negotiation.cc:299] Negotiation successful
0808 15:02:06.711066 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432}
I20260808 15:02:06.718240 18160 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [term 1 FOLLOWER]: Refusing update from remote peer 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:02:06.719280 18262 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:02:06.721101 18077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac: Bootstrap starting.
I20260808 15:02:06.730969 18077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac: Neither blocks nor log segments found. Creating new log.
I20260808 15:02:06.733489 18077 log.cc:824] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac: Log is configured to *not* fsync() on all Append() calls
I20260808 15:02:06.738334 18217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a. Latest consensus state: current_term: 1 leader_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } } }
I20260808 15:02:06.738648 18217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:06.742563 18279 mvcc.cc:205] Tried to move back new op lower bound from 7316280634225410048 to 7316280633946578944. Current Snapshot: MvccSnapshot[applied={T|T < 7316280634225410048}]
I20260808 15:02:06.745111 18280 mvcc.cc:205] Tried to move back new op lower bound from 7316280634225410048 to 7316280633946578944. Current Snapshot: MvccSnapshot[applied={T|T < 7316280634225410048}]
I20260808 15:02:06.751384 18077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac: No bootstrap required, opened a new log
I20260808 15:02:06.752573 18224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } } }
I20260808 15:02:06.752897 18224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [sys.catalog]: This master's current role is: LEADER
I20260808 15:02:06.754472 18276 catalog_manager.cc:1347] Generated new cluster ID: 95561e52b7744527827d45003181e028
I20260808 15:02:06.754587 18276 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:02:06.765602 18217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } } }
I20260808 15:02:06.765874 18217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:06.765964 18077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } }
I20260808 15:02:06.766319 18077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 273ccd9e4d5b4208b5712914cca2b1ac, State: Initialized, Role: FOLLOWER
I20260808 15:02:06.766764 18077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } }
I20260808 15:02:06.768025 18285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } } }
I20260808 15:02:06.768846 18077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:02:06.769054 18042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "273ccd9e4d5b4208b5712914cca2b1ac"
I20260808 15:02:06.769462 18041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:02:06.769770 18285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:06.773070 18041 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [term 1 FOLLOWER]: Refusing update from remote peer 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:02:06.775321 18262 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:02:06.777912 18042 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a in term 1.
I20260808 15:02:06.789316 18285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a. Latest consensus state: current_term: 1 leader_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } } }
I20260808 15:02:06.789615 18285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:06.790053 18291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } } }
I20260808 15:02:06.791428 18291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:06.804908 18262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 34419 } } peers { permanent_uuid: "273ccd9e4d5b4208b5712914cca2b1ac" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 39535 } } peers { permanent_uuid: "6c0539d3354f45b8ba112469ad2ef685" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 46011 } } }
I20260808 15:02:06.805214 18262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a [sys.catalog]: This master's current role is: LEADER
I20260808 15:02:06.809309 18276 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:02:06.818085 18276 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:02:06.840886 18276 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e0b8f2a9c9b4e6c8b1f0a2d0f9b1a2a: Generated new TSK 0
I20260808 15:02:06.841980 18276 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:02:06.868490 18311 catalog_manager.cc:1259] Loaded cluster ID: 95561e52b7744527827d45003181e028
I20260808 15:02:06.868717 18311 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac: loading cluster ID for follower catalog manager: success
I20260808 15:02:06.872373 18311 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac: acquiring CA information for follower catalog manager: success
I20260808 15:02:06.874912 18311 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 273ccd9e4d5b4208b5712914cca2b1ac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 15:02:06.988060 18208 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:06.976966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38130 (local address 127.12.73.190:34419)
0808 15:02:06.977239 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.977248 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.985821 (+ 8573us) server_negotiation.cc:407] Connection header received
0808 15:02:06.986180 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.986189 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.986318 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.986415 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.987778 (+ 1363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38130: BlockingRecv error: recv got EOF from 127.0.0.1:38130 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 15:02:06.999496 18086 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:06.978847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45856 (local address 127.12.73.189:39535)
0808 15:02:06.979041 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.979047 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:06.989670 (+ 10623us) server_negotiation.cc:407] Connection header received
0808 15:02:06.997702 (+ 8032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:06.997712 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:06.997847 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:06.997946 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:06.999194 (+ 1248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45856: BlockingRecv error: recv got EOF from 127.0.0.1:45856 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 15:02:07.002288 18214 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:06.987749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53136 (local address 127.12.73.188:46011)
0808 15:02:06.987921 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:06.987926 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.000330 (+ 12404us) server_negotiation.cc:407] Connection header received
0808 15:02:07.000604 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.000613 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.000728 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.000822 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:07.002028 (+ 1206us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53136: BlockingRecv error: recv got EOF from 127.0.0.1:53136 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 15:02:07.048564 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.029302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45872 (local address 127.12.73.189:39535)
0808 15:02:07.029507 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.029515 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.040344 (+ 10829us) server_negotiation.cc:407] Connection header received
0808 15:02:07.040919 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.040926 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.041231 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.041393 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.042120 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.043292 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.045398 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.046078 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.046191 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.046980 (+ 789us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.047730 (+ 750us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.047855 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.048096 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.048211 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260808 15:02:07.090408 18214 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:07.078937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53144 (local address 127.12.73.188:46011)
0808 15:02:07.079156 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.079165 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.088161 (+ 8996us) server_negotiation.cc:407] Connection header received
0808 15:02:07.088715 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.088722 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.088857 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.088956 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:07.090115 (+ 1159us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53144: BlockingRecv error: recv got EOF from 127.0.0.1:53144 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 15:02:07.144557 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.126673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45880 (local address 127.12.73.189:39535)
0808 15:02:07.126894 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.126902 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.137854 (+ 10952us) server_negotiation.cc:407] Connection header received
0808 15:02:07.138083 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.138089 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.138195 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.138301 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.138958 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.140149 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.142266 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.142960 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.143055 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.143679 (+ 624us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.143824 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.143887 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.144124 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.144220 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260808 15:02:07.191332 18214 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:07.178457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53146 (local address 127.12.73.188:46011)
0808 15:02:07.178670 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.178680 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.189292 (+ 10612us) server_negotiation.cc:407] Connection header received
0808 15:02:07.189797 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.189804 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.189905 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.189979 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:07.191032 (+ 1053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53146: BlockingRecv error: recv got EOF from 127.0.0.1:53146 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 15:02:07.248371 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.230360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45896 (local address 127.12.73.189:39535)
0808 15:02:07.230544 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.230551 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.241536 (+ 10985us) server_negotiation.cc:407] Connection header received
0808 15:02:07.241856 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.241862 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.241967 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.242033 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.242749 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.243988 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.246079 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.246662 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.246755 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.247444 (+ 689us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.247593 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.247659 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.247926 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.248018 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 15:02:07.299211 18214 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:07.285938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53150 (local address 127.12.73.188:46011)
0808 15:02:07.286119 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.286125 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.296763 (+ 10638us) server_negotiation.cc:407] Connection header received
0808 15:02:07.297339 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.297346 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.297450 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.297538 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:07.298942 (+ 1404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53150: BlockingRecv error: recv got EOF from 127.0.0.1:53150 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:02:07.315284 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.307872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45900 (local address 127.12.73.189:39535)
0808 15:02:07.308125 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.308131 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.308755 (+ 624us) server_negotiation.cc:407] Connection header received
0808 15:02:07.308965 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.308971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.309089 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.309227 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.309836 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.311077 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.313114 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.313853 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.313978 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.314483 (+ 505us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.314608 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.314703 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.314909 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.314994 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
W20260808 15:02:07.324913 18214 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:07.322966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53158 (local address 127.12.73.188:46011)
0808 15:02:07.323228 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.323234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.323488 (+ 254us) server_negotiation.cc:407] Connection header received
0808 15:02:07.323616 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.323622 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.323726 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.323840 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:07.324685 (+ 845us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53158: BlockingRecv error: recv got EOF from 127.0.0.1:53158 (error 108)
Metrics: {"server-negotiator.queue_time_us":136}
I20260808 15:02:07.343400 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.337296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45916 (local address 127.12.73.189:39535)
0808 15:02:07.337473 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.337478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.337853 (+ 375us) server_negotiation.cc:407] Connection header received
0808 15:02:07.338054 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.338059 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.338126 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.338207 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.338748 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.339526 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.341524 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.341974 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.342084 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.342574 (+ 490us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.342697 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.342766 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.342951 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.343016 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 15:02:07.352608 18214 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:07.350479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53166 (local address 127.12.73.188:46011)
0808 15:02:07.350694 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.350702 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.351078 (+ 376us) server_negotiation.cc:407] Connection header received
0808 15:02:07.351286 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.351289 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.351370 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.351453 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:07.352372 (+ 919us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53166: BlockingRecv error: recv got EOF from 127.0.0.1:53166 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 15:02:07.378996 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.372690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45930 (local address 127.12.73.189:39535)
0808 15:02:07.373022 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.373029 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.373395 (+ 366us) server_negotiation.cc:407] Connection header received
0808 15:02:07.373559 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.373565 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.373658 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.373825 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.374252 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.375482 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.376854 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.377606 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.377766 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.378198 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.378334 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.378446 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.378543 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.378643 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181}
W20260808 15:02:07.388046 18214 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:07.385913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53168 (local address 127.12.73.188:46011)
0808 15:02:07.386137 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.386143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.386511 (+ 368us) server_negotiation.cc:407] Connection header received
0808 15:02:07.386709 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.386712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.386794 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.386879 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:07.387807 (+ 928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53168: BlockingRecv error: recv got EOF from 127.0.0.1:53168 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 15:02:07.430424 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.424082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45932 (local address 127.12.73.189:39535)
0808 15:02:07.424326 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.424334 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.424730 (+ 396us) server_negotiation.cc:407] Connection header received
0808 15:02:07.424880 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.424886 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.424999 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.425135 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.425643 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.426836 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.428168 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.428954 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.429101 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.429566 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.429729 (+ 163us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.429847 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.429995 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.430079 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 15:02:07.439097 18214 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:07.437006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53170 (local address 127.12.73.188:46011)
0808 15:02:07.437298 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.437304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.437698 (+ 394us) server_negotiation.cc:407] Connection header received
0808 15:02:07.437844 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.437852 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.437963 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.438085 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:07.438840 (+ 755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53170: BlockingRecv error: recv got EOF from 127.0.0.1:53170 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 15:02:07.512512 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.506794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45940 (local address 127.12.73.189:39535)
0808 15:02:07.507039 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.507047 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.507368 (+ 321us) server_negotiation.cc:407] Connection header received
0808 15:02:07.507613 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.507618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.507687 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.507802 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.508255 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.509059 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.510638 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.511248 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.511386 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.511789 (+ 403us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.511893 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.511995 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.512155 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.512233 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 15:02:07.520744 18214 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:07.518438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53178 (local address 127.12.73.188:46011)
0808 15:02:07.518619 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.518626 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.519242 (+ 616us) server_negotiation.cc:407] Connection header received
0808 15:02:07.519393 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.519397 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.519486 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.519576 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:07.520515 (+ 939us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53178: BlockingRecv error: recv got EOF from 127.0.0.1:53178 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 15:02:07.658437 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.653001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45956 (local address 127.12.73.189:39535)
0808 15:02:07.653408 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.653415 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.653716 (+ 301us) server_negotiation.cc:407] Connection header received
0808 15:02:07.653887 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.653891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.653959 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.654043 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.654490 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.655210 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.656572 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.656980 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.657078 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.657636 (+ 558us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.657735 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.657804 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.658014 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.658170 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240}
I20260808 15:02:07.661659 18267 catalog_manager.cc:1259] Loaded cluster ID: 95561e52b7744527827d45003181e028
I20260808 15:02:07.661782 18267 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685: loading cluster ID for follower catalog manager: success
I20260808 15:02:07.664770 18267 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685: acquiring CA information for follower catalog manager: success
W20260808 15:02:07.666718 18214 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:07.664473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53194 (local address 127.12.73.188:46011)
0808 15:02:07.664687 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.664693 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.665086 (+ 393us) server_negotiation.cc:407] Connection header received
0808 15:02:07.665296 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.665301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.665369 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.665457 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:07.666407 (+ 950us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53194: BlockingRecv error: recv got EOF from 127.0.0.1:53194 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 15:02:07.667289 18267 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6c0539d3354f45b8ba112469ad2ef685: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 15:02:07.932011 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.926785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45960 (local address 127.12.73.189:39535)
0808 15:02:07.927037 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.927044 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.927297 (+ 253us) server_negotiation.cc:407] Connection header received
0808 15:02:07.927465 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.927470 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.927539 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.927624 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.928016 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.928770 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.930307 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.930757 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.930873 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.931275 (+ 402us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.931403 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.931481 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.931618 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.931689 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 15:02:07.943323 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.938110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53210 (local address 127.12.73.188:46011)
0808 15:02:07.938356 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.938361 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.938522 (+ 161us) server_negotiation.cc:407] Connection header received
0808 15:02:07.938618 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.938622 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.938780 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.938882 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.939258 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.939931 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.941238 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.941621 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.941716 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.942171 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.942715 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.942827 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.942920 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.942982 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260808 15:02:07.959517 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.950199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53220 (local address 127.12.73.188:46011)
0808 15:02:07.950747 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.950755 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.952324 (+ 1569us) server_negotiation.cc:407] Connection header received
0808 15:02:07.952848 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.952853 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.952948 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.953025 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.953816 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.954935 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.957338 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.957970 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.958062 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.958725 (+ 663us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.958875 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.958969 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.959143 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.959218 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396}
I20260808 15:02:07.959892 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.949659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45964 (local address 127.12.73.189:39535)
0808 15:02:07.950036 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.950045 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.953107 (+ 3062us) server_negotiation.cc:407] Connection header received
0808 15:02:07.953424 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.953428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.953491 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.953589 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.954355 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.955466 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.957658 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.958336 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.958430 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.959047 (+ 617us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.959170 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.959248 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.959455 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.959561 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218}
I20260808 15:02:07.960383 18497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:07.949482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38136 (local address 127.12.73.190:34419)
0808 15:02:07.953286 (+ 3804us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:07.953292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:07.953310 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:02:07.953431 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:07.953437 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:07.953654 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:07.953917 (+ 263us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:07.955145 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.955990 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.957871 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:07.958265 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:07.958403 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:07.958994 (+ 591us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:07.959466 (+ 472us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:07.959596 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:07.959854 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 15:02:07.959941 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3657,"thread_start_us":3556,"threads_started":1}
I20260808 15:02:07.966253 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17852
I20260808 15:02:07.967240 17954 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:02:08.078887 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 17852
I20260808 15:02:08.109247 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 17975
I20260808 15:02:08.110399 18070 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:02:08.221912 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 17975
I20260808 15:02:08.252722 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 18089
I20260808 15:02:08.254056 18194 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:02:08.365439 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 18089
2026-08-08T15:02:08Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5090 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 15:02:08 dist-test-slave-z8x9 krb5kdc[18515](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 15:02:08 dist-test-slave-z8x9 krb5kdc[18515](info): set up 2 sockets
Aug 08 15:02:08 dist-test-slave-z8x9 krb5kdc[18515](info): commencing operation
krb5kdc: starting...
W20260808 15:02:09.787529 12582 mini_kdc.cc:121] Time spent starting KDC: real 1.373s user 0.013s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/test-user.keytab.
Aug 08 15:02:10 dist-test-slave-z8x9 krb5kdc[18515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T15:02:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T15:02:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.73.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
Entry for principal kudu/127.12.73.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab.
I20260808 15:02:10.148968 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:38661
--webserver_interface=127.12.73.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:41125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:38661,127.12.73.189:45397,127.12.73.188:40531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 15:02:10.493986 18536 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 15:02:10.494390 18536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:02:10.494531 18536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:02:10.494658 18536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:02:10.506948 18536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:02:10.507076 18536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:02:10.507174 18536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:02:10.507274 18536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:02:10.507391 18536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:02:10.517675 18536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:41125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:38661,127.12.73.189:45397,127.12.73.188:40531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.190.keytab
--principal=kudu/127.12.73.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.190:38661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.73.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:02:10.518877 18536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:02:10.520125 18536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:02:10.532085 18547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:10.532039 18544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:10.532135 18543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:02:10.532662 18536 server_base.cc:1034] running on GCE node
I20260808 15:02:10.533560 18536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:02:10.534914 18536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:02:10.536181 18536 hybrid_clock.cc:648] HybridClock initialized: now 1786201330536091 us; error 51 us; skew 500 ppm
I20260808 15:02:10.536612 18536 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:02:10 dist-test-slave-z8x9 krb5kdc[18515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201330, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:02:10.540056 18536 init.cc:377] Logged in from keytab as kudu/127.12.73.190@KRBTEST.COM (short username kudu)
I20260808 15:02:10.541666 18536 webserver.cc:460] Webserver started at http://127.12.73.190:36891/ using document root <none> and password file <none>
I20260808 15:02:10.542434 18536 fs_manager.cc:359] Metadata directory not provided
I20260808 15:02:10.542562 18536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:02:10.542920 18536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:02:10.546096 18536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/data/instance:
uuid: "a219b0f2e1d741b4b9752979809abd7e"
format_stamp: "Formatted at 2026-08-08 15:02:10 on dist-test-slave-z8x9"
server_key: "79e3f9272f8315df5451955faac94fd0"
server_key_iv: "7f7574a0b103ea70fdc1c06804586f10"
server_key_version: "encryptionkey@0"
I20260808 15:02:10.546993 18536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/wal/instance:
uuid: "a219b0f2e1d741b4b9752979809abd7e"
format_stamp: "Formatted at 2026-08-08 15:02:10 on dist-test-slave-z8x9"
server_key: "79e3f9272f8315df5451955faac94fd0"
server_key_iv: "7f7574a0b103ea70fdc1c06804586f10"
server_key_version: "encryptionkey@0"
I20260808 15:02:10.552273 18536 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 15:02:10.555779 18561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:02:10.557099 18536 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:02:10.557402 18536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/wal
uuid: "a219b0f2e1d741b4b9752979809abd7e"
format_stamp: "Formatted at 2026-08-08 15:02:10 on dist-test-slave-z8x9"
server_key: "79e3f9272f8315df5451955faac94fd0"
server_key_iv: "7f7574a0b103ea70fdc1c06804586f10"
server_key_version: "encryptionkey@0"
I20260808 15:02:10.557634 18536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:02:10.588101 18536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:02:10.592242 18536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:02:10.592535 18536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:02:10.611634 18536 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.190:38661
I20260808 15:02:10.611656 18646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.190:38661 every 8 connection(s)
I20260808 15:02:10.612984 18536 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/data/info.pb
I20260808 15:02:10.614079 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 18536
I20260808 15:02:10.614296 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-0/wal/instance
I20260808 15:02:10.614717 12582 external_mini_cluster.cc:1428] Setting key 53c9d30d05a93ff57e7bbf7580e365fa
I20260808 15:02:10.616707 18647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:02:10.623065 18647 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:02:10 dist-test-slave-z8x9 krb5kdc[18515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201330, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:02:10.644963 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:10.626110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:38661 (local address 127.0.0.1:56238)
0808 15:02:10.626934 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:10.626986 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:10.628904 (+ 1918us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:10.629729 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:10.629735 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:10.630432 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:10.630746 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:10.630762 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:10.632316 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:10.632322 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:10.633481 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:10.633494 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:10.634411 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:10.634418 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:10.634596 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:10.635275 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:10.635297 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:10.637519 (+ 2222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:10.640763 (+ 3244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:10.640777 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:10.640789 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:10.641232 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:10.641649 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:10.641655 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:10.641659 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:10.641814 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:10.642542 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:10.642555 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:10.642772 (+ 217us) client_negotiation.cc:769] Sending connection context
0808 15:02:10.643015 (+ 243us) client_negotiation.cc:240] Negotiation successful
0808 15:02:10.643648 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"mutex_wait_us":160,"thread_start_us":362,"threads_started":1}
I20260808 15:02:10.644984 18654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:10.626110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56238 (local address 127.12.73.190:38661)
0808 15:02:10.627697 (+ 1587us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:10.627705 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:10.627758 (+ 53us) server_negotiation.cc:407] Connection header received
0808 15:02:10.629286 (+ 1528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:10.629292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:10.629512 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:10.629713 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:10.630973 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:10.632150 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:10.633622 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:10.634157 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:10.634362 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:10.637743 (+ 3381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:10.637750 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:10.637761 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:10.637787 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:10.640628 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:10.641364 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:10.641374 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:10.641378 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:10.641530 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:10.641934 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:10.641938 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:10.641948 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:10.642404 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:10.642620 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:10.643147 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 15:02:10.643529 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":1364,"thread_start_us":1151,"threads_started":1}
WARNING: no policy specified for kudu/127.12.73.189@KRBTEST.COM; defaulting to no policy
I20260808 15:02:10.648115 18647 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:02:10.649128 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:10.648733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60866)
0808 15:02:10.648902 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:10.649010 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 15:02:10.649420 18567 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.189@KRBTEST.COM" created.
I20260808 15:02:10.651139 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:10.650798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60878)
0808 15:02:10.650942 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:10.651010 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 15:02:10.651403 18647 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:45397: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.189.keytab.
Entry for principal kudu/127.12.73.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.189.keytab.
I20260808 15:02:10.692643 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.189:45397
--webserver_interface=127.12.73.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.189.keytab
--principal=kudu/127.12.73.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:41125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:38661,127.12.73.189:45397,127.12.73.188:40531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:02:10.700749 18647 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } attempt: 1
I20260808 15:02:10.702018 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:10.701544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60884)
0808 15:02:10.701755 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:10.701877 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 15:02:10.703038 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:10.702719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60898)
0808 15:02:10.702856 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:10.702919 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 15:02:10.703274 18647 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:45397: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
I20260808 15:02:10.771564 18647 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } attempt: 2
I20260808 15:02:10.772878 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:10.772290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60902)
0808 15:02:10.772582 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:10.772698 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260808 15:02:10.774076 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:10.773671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60910)
0808 15:02:10.773850 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:10.773930 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 15:02:10.774333 18647 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:45397: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
I20260808 15:02:10.865639 18647 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } attempt: 3
I20260808 15:02:10.866925 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:10.866382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60916)
0808 15:02:10.866633 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:10.866751 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 15:02:10.868081 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:10.867633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60930)
0808 15:02:10.867814 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:10.867907 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260808 15:02:10.868299 18647 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:45397: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
I20260808 15:02:11.011565 18647 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } attempt: 4
I20260808 15:02:11.012970 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.012284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60942)
0808 15:02:11.012661 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.012787 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183}
I20260808 15:02:11.014130 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.013715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60950)
0808 15:02:11.013878 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.013974 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 15:02:11.014329 18647 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.189:45397: Network error: Client connection negotiation failed: client connection to 127.12.73.189:45397: connect: Connection refused (error 111)
W20260808 15:02:11.034551 18660 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 15:02:11.034904 18660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:02:11.035030 18660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:02:11.035183 18660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:02:11.042465 18660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:02:11.042554 18660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:02:11.042656 18660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:02:11.042757 18660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:02:11.042855 18660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:02:11.052616 18660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:41125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:38661,127.12.73.189:45397,127.12.73.188:40531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.189.keytab
--principal=kudu/127.12.73.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.189:45397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.73.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:02:11.053966 18660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:02:11.055480 18660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:02:11.067885 18671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:11.067939 18669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:11.067847 18667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:02:11.070645 18660 server_base.cc:1034] running on GCE node
I20260808 15:02:11.071478 18660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:02:11.072862 18660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:02:11.074105 18660 hybrid_clock.cc:648] HybridClock initialized: now 1786201331074030 us; error 24 us; skew 500 ppm
I20260808 15:02:11.074458 18660 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201331, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:02:11.077684 18660 init.cc:377] Logged in from keytab as kudu/127.12.73.189@KRBTEST.COM (short username kudu)
I20260808 15:02:11.079238 18660 webserver.cc:460] Webserver started at http://127.12.73.189:38643/ using document root <none> and password file <none>
I20260808 15:02:11.079952 18660 fs_manager.cc:359] Metadata directory not provided
I20260808 15:02:11.080094 18660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:02:11.080436 18660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:02:11.083431 18660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/data/instance:
uuid: "41bef734b05f4596ae6a4f85bd91a9db"
format_stamp: "Formatted at 2026-08-08 15:02:11 on dist-test-slave-z8x9"
server_key: "093f92c68c377635ed83fbc68a8ea3a8"
server_key_iv: "9ead97a0d471644ef158b78a8320276b"
server_key_version: "encryptionkey@0"
I20260808 15:02:11.084245 18660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/wal/instance:
uuid: "41bef734b05f4596ae6a4f85bd91a9db"
format_stamp: "Formatted at 2026-08-08 15:02:11 on dist-test-slave-z8x9"
server_key: "093f92c68c377635ed83fbc68a8ea3a8"
server_key_iv: "9ead97a0d471644ef158b78a8320276b"
server_key_version: "encryptionkey@0"
I20260808 15:02:11.089385 18660 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 15:02:11.092767 18682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:02:11.094038 18660 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 15:02:11.094228 18660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/wal
uuid: "41bef734b05f4596ae6a4f85bd91a9db"
format_stamp: "Formatted at 2026-08-08 15:02:11 on dist-test-slave-z8x9"
server_key: "093f92c68c377635ed83fbc68a8ea3a8"
server_key_iv: "9ead97a0d471644ef158b78a8320276b"
server_key_version: "encryptionkey@0"
I20260808 15:02:11.094466 18660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:02:11.126474 18660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:02:11.130591 18660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:02:11.130887 18660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:02:11.149943 18660 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.189:45397
I20260808 15:02:11.149983 18762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.189:45397 every 8 connection(s)
I20260808 15:02:11.151293 18660 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/data/info.pb
I20260808 15:02:11.155035 18764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:02:11.157555 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 18660
I20260808 15:02:11.157761 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-1/wal/instance
I20260808 15:02:11.158228 12582 external_mini_cluster.cc:1428] Setting key 2315b8eca61d5c1fc7a9d1eca0a48982
I20260808 15:02:11.162106 18764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201331, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.189@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:02:11.182485 18766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.164694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56240 (local address 127.12.73.190:38661)
0808 15:02:11.165251 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.165255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.166251 (+ 996us) server_negotiation.cc:407] Connection header received
0808 15:02:11.168115 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.168121 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.168217 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.168347 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.169969 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.170674 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.172230 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.172642 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.172787 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.176308 (+ 3521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.176313 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.176316 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.176358 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.179275 (+ 2917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.180069 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.180073 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.180075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.180198 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.180649 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.180656 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.180664 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.180939 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.181127 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.181874 (+ 747us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.182098 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":285,"threads_started":1}
I20260808 15:02:11.183481 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.165306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:38661 (local address 127.0.0.1:56240)
0808 15:02:11.166045 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.166090 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:11.167844 (+ 1754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:11.168599 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:11.168607 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:11.169132 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:11.169747 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.169764 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.170859 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.170864 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.172066 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.172079 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.172884 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.172891 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.173121 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.173910 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:11.173933 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:11.176070 (+ 2137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:11.179440 (+ 3370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.179449 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.179464 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.179904 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.180324 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.180329 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.180333 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.180517 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.181097 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:11.181106 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:11.181490 (+ 384us) client_negotiation.cc:769] Sending connection context
0808 15:02:11.181769 (+ 279us) client_negotiation.cc:240] Negotiation successful
0808 15:02:11.182303 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":314,"threads_started":1}
I20260808 15:02:11.185266 18764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.73.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.73.188@KRBTEST.COM" created.
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201331, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.189@KRBTEST.COM for kudu/127.12.73.189@KRBTEST.COM
I20260808 15:02:11.201500 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.185992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60962)
0808 15:02:11.186167 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.186190 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:11.186288 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:11.187488 (+ 1200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:11.187491 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:11.187870 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:11.188005 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.188013 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.190180 (+ 2167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.190184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.191033 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.191044 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.192155 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.192159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.192288 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.192946 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:11.192963 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:11.195738 (+ 2775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:11.199017 (+ 3279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.199024 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.199028 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.199385 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.199762 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.199768 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.199771 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.199914 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.200498 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:11.200505 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:11.200659 (+ 154us) client_negotiation.cc:769] Sending connection context
0808 15:02:11.200805 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 15:02:11.201080 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 15:02:11.201588 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.186276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60962 (local address 127.12.73.189:45397)
0808 15:02:11.186968 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.186979 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.187013 (+ 34us) server_negotiation.cc:407] Connection header received
0808 15:02:11.187072 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.187080 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.187317 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.187479 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.188189 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.190030 (+ 1841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.191183 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.191994 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.192092 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.195954 (+ 3862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.195966 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.195977 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.196009 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.198881 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.199517 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.199527 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.199535 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.199647 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.200022 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.200029 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.200032 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.200368 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.200595 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.200950 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.201215 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":462,"thread_start_us":293,"threads_started":1}
I20260808 15:02:11.203863 18764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:02:11.205134 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.204692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37208)
0808 15:02:11.204871 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.204995 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 15:02:11.205569 18687 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
I20260808 15:02:11.207136 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.206762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37224)
0808 15:02:11.206891 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.207009 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 15:02:11.207414 18764 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:40531: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.73.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.188.keytab.
Entry for principal kudu/127.12.73.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.188.keytab.
I20260808 15:02:11.237017 12582 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
/tmp/dist-test-tasktuKHj1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.188:40531
--webserver_interface=127.12.73.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.188.keytab
--principal=kudu/127.12.73.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.73.148:41125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.73.190:38661,127.12.73.189:45397,127.12.73.188:40531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 15:02:11.256743 18764 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } attempt: 1
I20260808 15:02:11.258069 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.257599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37226)
0808 15:02:11.257808 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.257909 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 15:02:11.259102 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.258786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37228)
0808 15:02:11.258936 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.259004 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 15:02:11.259380 18764 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:40531: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
I20260808 15:02:11.313637 18647 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } attempt: 5
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201330, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for kudu/127.12.73.189@KRBTEST.COM
I20260808 15:02:11.327611 18764 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } attempt: 2
I20260808 15:02:11.328768 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.328215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37234)
0808 15:02:11.328464 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.328567 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260808 15:02:11.329321 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.314446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60968)
0808 15:02:11.314708 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.314735 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:11.314891 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:11.315268 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:11.315273 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:11.315879 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:11.316124 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.316137 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.317158 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.317202 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.318703 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.318719 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.319464 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.319470 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.319690 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.320404 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:11.320427 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:11.323222 (+ 2795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:11.326398 (+ 3176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.326406 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.326411 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.327009 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.327457 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.327465 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.327471 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.327667 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.328268 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:11.328274 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:11.328442 (+ 168us) client_negotiation.cc:769] Sending connection context
0808 15:02:11.328649 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 15:02:11.328958 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 15:02:11.329568 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.314544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60968 (local address 127.12.73.189:45397)
0808 15:02:11.314737 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.314742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.314827 (+ 85us) server_negotiation.cc:407] Connection header received
0808 15:02:11.315036 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.315040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.315105 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.315190 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.316286 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.316983 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.318868 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.319292 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.319384 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.323444 (+ 4060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.323450 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.323453 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.323484 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.326254 (+ 2770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.327143 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.327151 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.327156 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.327302 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.327805 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.327810 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.327813 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.328139 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.328304 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.328846 (+ 542us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.329143 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 15:02:11.330078 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.329611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37246)
0808 15:02:11.329824 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.329911 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
W20260808 15:02:11.330379 18764 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:40531: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
I20260808 15:02:11.330814 18647 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:02:11.331947 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.331484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37250)
0808 15:02:11.331685 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.331778 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 15:02:11.332985 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.332597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37264)
0808 15:02:11.332767 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.332866 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260808 15:02:11.333241 18647 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:40531: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
I20260808 15:02:11.384518 18647 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } attempt: 1
I20260808 15:02:11.385962 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.385320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37280)
0808 15:02:11.385574 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.385720 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 15:02:11.387017 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.386642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37288)
0808 15:02:11.386813 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.386894 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 15:02:11.387357 18647 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:40531: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
I20260808 15:02:11.421607 18764 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } attempt: 3
I20260808 15:02:11.422747 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.422256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37292)
0808 15:02:11.422480 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.422583 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 15:02:11.423831 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.423400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37304)
0808 15:02:11.423643 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.423718 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
W20260808 15:02:11.424057 18764 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:40531: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
I20260808 15:02:11.455682 18647 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } attempt: 2
I20260808 15:02:11.456947 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.456456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37318)
0808 15:02:11.456679 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.456768 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 15:02:11.458031 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.457686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37322)
0808 15:02:11.457843 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.457930 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 15:02:11.458236 18647 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:40531: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
I20260808 15:02:11.564546 18647 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } attempt: 3
I20260808 15:02:11.565765 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.565311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37328)
0808 15:02:11.565508 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.565597 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 15:02:11.566843 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.566424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37330)
0808 15:02:11.566656 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.566733 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
W20260808 15:02:11.567039 18647 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:40531: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
I20260808 15:02:11.567258 18764 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } attempt: 4
I20260808 15:02:11.568216 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.567763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37342)
0808 15:02:11.567985 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.568066 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 15:02:11.569159 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.568845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37358)
0808 15:02:11.568992 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.569065 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 15:02:11.569432 18764 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.73.188:40531: Network error: Client connection negotiation failed: client connection to 127.12.73.188:40531: connect: Connection refused (error 111)
W20260808 15:02:11.586759 18776 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 15:02:11.587105 18776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 15:02:11.587241 18776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 15:02:11.587383 18776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 15:02:11.594843 18776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 15:02:11.594924 18776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 15:02:11.595007 18776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 15:02:11.595088 18776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 15:02:11.595201 18776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 15:02:11.605104 18776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.73.148:41125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.73.190:38661,127.12.73.189:45397,127.12.73.188:40531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/krb5kdc/kudu_127.12.73.188.keytab
--principal=kudu/127.12.73.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.73.188:40531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.73.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 15:02:11.606475 18776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 15:02:11.607755 18776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 15:02:11.620090 18784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:11.620290 18783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 15:02:11.620676 18788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 15:02:11.621100 18776 server_base.cc:1034] running on GCE node
I20260808 15:02:11.622056 18776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 15:02:11.623764 18776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 15:02:11.625041 18776 hybrid_clock.cc:648] HybridClock initialized: now 1786201331624983 us; error 49 us; skew 500 ppm
I20260808 15:02:11.625427 18776 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201331, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 15:02:11.628741 18776 init.cc:377] Logged in from keytab as kudu/127.12.73.188@KRBTEST.COM (short username kudu)
I20260808 15:02:11.630281 18776 webserver.cc:460] Webserver started at http://127.12.73.188:38183/ using document root <none> and password file <none>
I20260808 15:02:11.630980 18776 fs_manager.cc:359] Metadata directory not provided
I20260808 15:02:11.631134 18776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 15:02:11.631469 18776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 15:02:11.634567 18776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/data/instance:
uuid: "216b11082ef94435893461c109c96138"
format_stamp: "Formatted at 2026-08-08 15:02:11 on dist-test-slave-z8x9"
server_key: "74b8db17ce05bb962a2292ffd652f852"
server_key_iv: "61559c4c2454dadf46fd30a21433f847"
server_key_version: "encryptionkey@0"
I20260808 15:02:11.635353 18776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/wal/instance:
uuid: "216b11082ef94435893461c109c96138"
format_stamp: "Formatted at 2026-08-08 15:02:11 on dist-test-slave-z8x9"
server_key: "74b8db17ce05bb962a2292ffd652f852"
server_key_iv: "61559c4c2454dadf46fd30a21433f847"
server_key_version: "encryptionkey@0"
I20260808 15:02:11.640365 18776 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 15:02:11.643760 18805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 15:02:11.645009 18776 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 15:02:11.645252 18776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/data,/tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/wal
uuid: "216b11082ef94435893461c109c96138"
format_stamp: "Formatted at 2026-08-08 15:02:11 on dist-test-slave-z8x9"
server_key: "74b8db17ce05bb962a2292ffd652f852"
server_key_iv: "61559c4c2454dadf46fd30a21433f847"
server_key_version: "encryptionkey@0"
I20260808 15:02:11.645516 18776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 15:02:11.669091 18776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 15:02:11.673276 18776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 15:02:11.673560 18776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 15:02:11.692745 18776 rpc_server.cc:307] RPC server started. Bound to: 127.12.73.188:40531
I20260808 15:02:11.692770 18893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.73.188:40531 every 8 connection(s)
I20260808 15:02:11.694293 18776 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/data/info.pb
I20260808 15:02:11.698287 18898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 15:02:11.702442 12582 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu as pid 18776
I20260808 15:02:11.702633 12582 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktuKHj1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200952883082-12582-0/minicluster-data/master-2/wal/instance
I20260808 15:02:11.703107 12582 external_mini_cluster.cc:1428] Setting key 5e92f13de42f91bc0008b8d5fc78d278
I20260808 15:02:11.705675 18898 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.188@KRBTEST.COM
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201331, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.188@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:02:11.725100 18905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.709725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56252 (local address 127.12.73.190:38661)
0808 15:02:11.711229 (+ 1504us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.711235 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.711253 (+ 18us) server_negotiation.cc:407] Connection header received
0808 15:02:11.711314 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.711320 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.711394 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.711514 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.712643 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.713439 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.714927 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.715320 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.715465 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.719154 (+ 3689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.719159 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.719162 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.719194 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.722182 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.722921 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.722927 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.722931 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.723067 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.723455 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.723461 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.723464 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.723724 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.723890 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.724442 (+ 552us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.724658 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1374,"thread_start_us":1193,"threads_started":1}
I20260808 15:02:11.725924 18903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.709694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.190:38661 (local address 127.0.0.1:56252)
0808 15:02:11.710486 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.710527 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:11.710706 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:11.711581 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:11.711586 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:11.712196 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:11.712474 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.712488 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.713623 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.713627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.714764 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.714776 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.715563 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.715571 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.715729 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.716364 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:11.716384 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:11.718947 (+ 2563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:11.722336 (+ 3389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.722347 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.722358 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.722791 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.723189 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.723194 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.723198 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.723339 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.723874 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:11.723885 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:11.724085 (+ 200us) client_negotiation.cc:769] Sending connection context
0808 15:02:11.724331 (+ 246us) client_negotiation.cc:240] Negotiation successful
0808 15:02:11.724908 (+ 577us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"mutex_wait_us":158,"thread_start_us":382,"threads_started":1}
I20260808 15:02:11.725943 18901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.704881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37374 (local address 127.12.73.188:40531)
0808 15:02:11.705722 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.705735 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.705776 (+ 41us) server_negotiation.cc:407] Connection header received
0808 15:02:11.707567 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.707589 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.708079 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.708461 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.710405 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.712246 (+ 1841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.713576 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.714270 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.714477 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.718871 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.718879 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.718891 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.718924 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.721757 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.722498 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.722505 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.722507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.722663 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.723122 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.723128 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.723131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.723622 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.723993 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.724308 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.724730 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":638,"thread_start_us":436,"threads_started":1}
I20260808 15:02:11.727525 18898 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201331, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.188@KRBTEST.COM for kudu/127.12.73.189@KRBTEST.COM
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.190@KRBTEST.COM
I20260808 15:02:11.742573 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.728497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60976 (local address 127.12.73.189:45397)
0808 15:02:11.728730 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.728736 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.728755 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:02:11.728814 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.728818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.728905 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.729014 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.729930 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.731080 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.732821 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.733536 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.733664 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.736773 (+ 3109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.736782 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.736789 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.736845 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.739741 (+ 2896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.740562 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.740566 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.740568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.740701 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.741216 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.741223 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.741227 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.741556 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.741666 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.742155 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.742311 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 15:02:11.742739 18903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.728219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.189:45397 (local address 127.0.0.1:60976)
0808 15:02:11.728391 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.728408 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:11.728493 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:11.729092 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:11.729100 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:11.729565 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:11.729759 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.729774 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.731235 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.731239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.732678 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.732690 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.733700 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.733704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.733871 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.734424 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:11.734447 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:11.736567 (+ 2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:11.739888 (+ 3321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.739894 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.739898 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.740425 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.740837 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.740843 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.740847 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.741033 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.741711 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:11.741719 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:11.741906 (+ 187us) client_negotiation.cc:769] Sending connection context
0808 15:02:11.742073 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 15:02:11.742356 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 15:02:11.743943 18898 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } has no permanent_uuid. Determining permanent_uuid...
I20260808 15:02:11.744239 18647 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } attempt: 4
I20260808 15:02:11.747460 18905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.729340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56262 (local address 127.12.73.190:38661)
0808 15:02:11.729505 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.729509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.729722 (+ 213us) server_negotiation.cc:407] Connection header received
0808 15:02:11.729811 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.729819 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.729914 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.729993 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.731444 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.732507 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.734166 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.734768 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.734908 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.739448 (+ 4540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.739453 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.739456 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.739486 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.743017 (+ 3531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.743847 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.743851 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.743853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.743973 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.744404 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.744413 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.744415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.744745 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.746758 (+ 2013us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.746908 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.747128 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201331, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.188@KRBTEST.COM for kudu/127.12.73.188@KRBTEST.COM
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201330, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.190@KRBTEST.COM for kudu/127.12.73.188@KRBTEST.COM
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.73.189@KRBTEST.COM
I20260808 15:02:11.760290 18903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.744945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37378)
0808 15:02:11.745082 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.745101 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:11.745225 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:11.745575 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:11.745579 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:11.745975 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:11.746186 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.746205 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.747665 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.747670 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.749039 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.749055 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.750122 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.750128 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.750312 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.750907 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:11.750924 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:11.752949 (+ 2025us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:11.756735 (+ 3786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.756739 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.756741 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.757078 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.758348 (+ 1270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.758351 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.758353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.758466 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.759079 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:11.759085 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:11.759270 (+ 185us) client_negotiation.cc:769] Sending connection context
0808 15:02:11.759500 (+ 230us) client_negotiation.cc:240] Negotiation successful
0808 15:02:11.759868 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 15:02:11.760465 18901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.744938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37378 (local address 127.12.73.188:40531)
0808 15:02:11.745326 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.745332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.745353 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:02:11.745397 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.745400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.745447 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.745562 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.746398 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.747471 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.749259 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.749912 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.749988 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.753132 (+ 3144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.753137 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.753140 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.753223 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.756597 (+ 3374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.757246 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.757254 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.757259 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.757433 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.758591 (+ 1158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.758596 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.758620 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.758935 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.759112 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.759636 (+ 524us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.760081 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":181,"server-negotiator.queue_time_us":267}
I20260808 15:02:11.761144 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.744810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37376)
0808 15:02:11.745009 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.745028 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:11.745125 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:11.746139 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:11.746146 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:11.746667 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:11.746830 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.746839 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.748314 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.748320 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.749794 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.749811 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.751082 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.751092 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.751285 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.751879 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:11.751901 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:11.754547 (+ 2646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:11.758342 (+ 3795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.758348 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.758352 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.758895 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.759324 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.759329 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.759333 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.759500 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.760140 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:11.760145 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:11.760334 (+ 189us) client_negotiation.cc:769] Sending connection context
0808 15:02:11.760463 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 15:02:11.760783 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 15:02:11.762368 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.745061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37376 (local address 127.12.73.188:40531)
0808 15:02:11.745815 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.745821 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.745842 (+ 21us) server_negotiation.cc:407] Connection header received
0808 15:02:11.745890 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.745895 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.745970 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.746073 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.746997 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.748130 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.749993 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.750881 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.751573 (+ 692us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.754800 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.754806 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.754809 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.754841 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.758201 (+ 3360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.759034 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.759042 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.759045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.759201 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.759632 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.759637 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.759640 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.759979 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.761420 (+ 1441us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.761591 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.761802 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":368,"threads_started":1}
I20260808 15:02:11.766706 18898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138: Bootstrap starting.
I20260808 15:02:11.767287 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.749266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60988 (local address 127.12.73.189:45397)
0808 15:02:11.749532 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.749537 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.749556 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:02:11.749675 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.749680 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.749753 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.749848 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.751612 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.752703 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.754612 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.755306 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.755445 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.760592 (+ 5147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.760599 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.760605 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.760647 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.764223 (+ 3576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.765055 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.765061 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.765064 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.765271 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.765706 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.765711 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.765715 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.766039 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.766313 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.766671 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.766952 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
I20260808 15:02:11.767565 18647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e: Bootstrap starting.
I20260808 15:02:11.770771 18898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138: Neither blocks nor log segments found. Creating new log.
I20260808 15:02:11.771191 18647 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e: Neither blocks nor log segments found. Creating new log.
I20260808 15:02:11.772092 18898 log.cc:824] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138: Log is configured to *not* fsync() on all Append() calls
I20260808 15:02:11.772401 18647 log.cc:824] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e: Log is configured to *not* fsync() on all Append() calls
I20260808 15:02:11.772461 12582 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 15:02:11.775599 18898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138: No bootstrap required, opened a new log
I20260808 15:02:11.775581 18603 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a219b0f2e1d741b4b9752979809abd7e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56262
I20260808 15:02:11.780561 18647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e: No bootstrap required, opened a new log
I20260808 15:02:11.784113 18898 raft_consensus.cc:348] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } }
I20260808 15:02:11.784538 18898 raft_consensus.cc:729] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216b11082ef94435893461c109c96138, State: Initialized, Role: FOLLOWER
I20260808 15:02:11.785035 18898 consensus_queue.cc:260] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } }
I20260808 15:02:11.785933 18647 raft_consensus.cc:348] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } }
I20260808 15:02:11.786239 18647 raft_consensus.cc:729] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a219b0f2e1d741b4b9752979809abd7e, State: Initialized, Role: FOLLOWER
I20260808 15:02:11.786633 18647 consensus_queue.cc:260] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } }
I20260808 15:02:11.786386 18912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } } }
I20260808 15:02:11.787252 18912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:11.787513 18898 sys_catalog.cc:564] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:02:11.787565 18913 sys_catalog.cc:455] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } } }
I20260808 15:02:11.787966 18913 sys_catalog.cc:458] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:11.788522 18647 sys_catalog.cc:564] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:02:11.788669 18603 raft_consensus.cc:482] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 15:02:11.788893 18603 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:02:11.793473 18603 raft_consensus.cc:504] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } }
I20260808 15:02:11.795594 18603 leader_election.cc:288] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [CANDIDATE]: Term 1 election: Requested vote from peers 41bef734b05f4596ae6a4f85bd91a9db (127.12.73.189:45397), 216b11082ef94435893461c109c96138 (127.12.73.188:40531)
I20260808 15:02:11.797041 18852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a219b0f2e1d741b4b9752979809abd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "216b11082ef94435893461c109c96138"
I20260808 15:02:11.797685 18852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:02:11.802376 18852 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a219b0f2e1d741b4b9752979809abd7e in term 1.
I20260808 15:02:11.803885 18569 leader_election.cc:302] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216b11082ef94435893461c109c96138, a219b0f2e1d741b4b9752979809abd7e; no voters:
I20260808 15:02:11.804502 18913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 15:02:11.812234 18913 raft_consensus.cc:686] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [term 1 LEADER]: Becoming Leader. State: Replica: a219b0f2e1d741b4b9752979809abd7e, State: Running, Role: LEADER
I20260808 15:02:11.812990 18913 consensus_queue.cc:237] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } }
I20260808 15:02:11.826609 18958 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 15:02:11.826395 18941 sys_catalog.cc:455] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a219b0f2e1d741b4b9752979809abd7e. Latest consensus state: current_term: 1 leader_uuid: "a219b0f2e1d741b4b9752979809abd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } } }
I20260808 15:02:11.826879 18941 sys_catalog.cc:458] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [sys.catalog]: This master's current role is: LEADER
I20260808 15:02:11.829939 18776 master_runner.cc:186] Error getting master registration for 127.12.73.190:38661: OK, instance_id { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" instance_seqno: 1786201330606313 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 15:02:11.840315 18776 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:02:11.841831 18959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260808 15:02:11.845638 18572 tablet.cc:2369] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 15:02:11.856629 18959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 15:02:11.858013 18905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.813826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56264 (local address 127.12.73.190:38661)
0808 15:02:11.814037 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.814045 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.820397 (+ 6352us) server_negotiation.cc:407] Connection header received
0808 15:02:11.822528 (+ 2131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.822537 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.822640 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.822736 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.831408 (+ 8672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.832576 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.836118 (+ 3542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.836805 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.836933 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.848412 (+ 11479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.848422 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.848432 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.848504 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.852889 (+ 4385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.854541 (+ 1652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.854549 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.854553 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.854751 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.855354 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.855361 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.855367 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.855789 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.856163 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.856938 (+ 775us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.857454 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 15:02:11.858623 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.814619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37390 (local address 127.12.73.188:40531)
0808 15:02:11.814853 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.814863 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.820972 (+ 6109us) server_negotiation.cc:407] Connection header received
0808 15:02:11.821236 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.821246 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.821391 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.821553 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.833423 (+ 11870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.834567 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.841704 (+ 7137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.842355 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.842478 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.850718 (+ 8240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.850728 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.850736 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.850788 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.854471 (+ 3683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.855393 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.855400 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.855404 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.855552 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.855986 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.855991 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.855997 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.856385 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.856631 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.857769 (+ 1138us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.858005 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 15:02:11.868273 18852 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [term 1 FOLLOWER]: Refusing update from remote peer a219b0f2e1d741b4b9752979809abd7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:02:11.868677 18764 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } attempt: 5
I20260808 15:02:11.869287 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.820569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60990 (local address 127.12.73.189:45397)
0808 15:02:11.820771 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.820777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.841840 (+ 21063us) server_negotiation.cc:407] Connection header received
0808 15:02:11.842817 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.842825 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.842921 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.843023 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.848783 (+ 5760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.849941 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.852697 (+ 2756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.853481 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.853593 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.861551 (+ 7958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.861560 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.861567 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.861621 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.865482 (+ 3861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.866369 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.866376 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.866379 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.866577 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.867059 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.867064 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.867067 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.867468 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.867691 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.868277 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.868529 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 15:02:11.870607 18941 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Aug 08 15:02:11 dist-test-slave-z8x9 krb5kdc[18515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786201331, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.73.189@KRBTEST.COM for kudu/127.12.73.188@KRBTEST.COM
I20260808 15:02:11.872047 18536 master_runner.cc:186] Error getting master registration for 127.12.73.189:45397: OK, instance_id { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" instance_seqno: 1786201331144381 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 15:02:11.888587 18536 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 15:02:11.895025 18912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a219b0f2e1d741b4b9752979809abd7e. Latest consensus state: current_term: 1 leader_uuid: "a219b0f2e1d741b4b9752979809abd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } } }
I20260808 15:02:11.895401 18912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:11.896461 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.870191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37406 (local address 127.12.73.188:40531)
0808 15:02:11.870360 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:11.870366 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:11.870385 (+ 19us) server_negotiation.cc:407] Connection header received
0808 15:02:11.870432 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:11.870436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:11.870513 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:11.870617 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:11.871783 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.873120 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.879261 (+ 6141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.879954 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.880085 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.886122 (+ 6037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 15:02:11.886128 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 15:02:11.886133 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 15:02:11.886171 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 15:02:11.890347 (+ 4176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.891264 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.891269 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.891272 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.891760 (+ 488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 15:02:11.892630 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 15:02:11.892676 (+ 46us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 15:02:11.892680 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 15:02:11.893678 (+ 998us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 15:02:11.894045 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:11.895151 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0808 15:02:11.895845 (+ 694us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 15:02:11.896965 18965 mvcc.cc:205] Tried to move back new op lower bound from 7316280655316635648 to 7316280655114424320. Current Snapshot: MvccSnapshot[applied={T|T < 7316280655316635648}]
I20260808 15:02:11.898722 18767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:11.869264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.73.188:40531 (local address 127.0.0.1:37406)
0808 15:02:11.869472 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 15:02:11.869496 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 15:02:11.869610 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 15:02:11.870794 (+ 1184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 15:02:11.870799 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 15:02:11.871358 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0808 15:02:11.871603 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.871618 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.877478 (+ 5860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.877485 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.879086 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 15:02:11.879104 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 15:02:11.880495 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 15:02:11.880502 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 15:02:11.880930 (+ 428us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:11.881900 (+ 970us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 15:02:11.881927 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 15:02:11.885836 (+ 3909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 15:02:11.890531 (+ 4695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.890538 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.890542 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.891085 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.892037 (+ 952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 15:02:11.892043 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 15:02:11.892046 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 15:02:11.892404 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 15:02:11.894239 (+ 1835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 15:02:11.894244 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 15:02:11.894523 (+ 279us) client_negotiation.cc:769] Sending connection context
0808 15:02:11.897020 (+ 2497us) client_negotiation.cc:240] Negotiation successful
0808 15:02:11.897788 (+ 768us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 15:02:11.905694 18941 sys_catalog.cc:455] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a219b0f2e1d741b4b9752979809abd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } } }
I20260808 15:02:11.905995 18941 sys_catalog.cc:458] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [sys.catalog]: This master's current role is: LEADER
I20260808 15:02:11.908408 18764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db: Bootstrap starting.
I20260808 15:02:11.909209 18959 catalog_manager.cc:1347] Generated new cluster ID: ae9a57ad8a0d46c9b12b88c55e18f249
I20260808 15:02:11.909322 18959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 15:02:11.912510 18764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db: Neither blocks nor log segments found. Creating new log.
I20260808 15:02:11.913759 18764 log.cc:824] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db: Log is configured to *not* fsync() on all Append() calls
I20260808 15:02:11.914958 18912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a219b0f2e1d741b4b9752979809abd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } } }
I20260808 15:02:11.915239 18912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:11.922325 18764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db: No bootstrap required, opened a new log
I20260808 15:02:11.922765 18959 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 15:02:11.924806 18959 catalog_manager.cc:1504] Loading token signing keys...
I20260808 15:02:11.935711 18764 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } }
I20260808 15:02:11.936137 18764 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41bef734b05f4596ae6a4f85bd91a9db, State: Initialized, Role: FOLLOWER
I20260808 15:02:11.936662 18764 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } }
I20260808 15:02:11.939323 18959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e: Generated new TSK 0
I20260808 15:02:11.939707 18764 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [sys.catalog]: configured and running, proceeding with master startup.
I20260808 15:02:11.939818 18972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } } }
I20260808 15:02:11.940234 18972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:11.940330 18959 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 15:02:11.941927 18727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a219b0f2e1d741b4b9752979809abd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "41bef734b05f4596ae6a4f85bd91a9db"
I20260808 15:02:11.942601 18726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [term 0 FOLLOWER]: Advancing to term 1
I20260808 15:02:11.948765 18726 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [term 1 FOLLOWER]: Refusing update from remote peer a219b0f2e1d741b4b9752979809abd7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 15:02:11.953883 18727 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a219b0f2e1d741b4b9752979809abd7e in term 1.
I20260808 15:02:11.954957 18913 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 15:02:11.990870 18972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [sys.catalog]: SysCatalogTable state changed. Reason: New leader a219b0f2e1d741b4b9752979809abd7e. Latest consensus state: current_term: 1 leader_uuid: "a219b0f2e1d741b4b9752979809abd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } } }
I20260808 15:02:11.991225 18972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:11.991519 18991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a219b0f2e1d741b4b9752979809abd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } } }
I20260808 15:02:11.991977 18991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db [sys.catalog]: This master's current role is: FOLLOWER
I20260808 15:02:12.003077 18997 catalog_manager.cc:1259] Loaded cluster ID: ae9a57ad8a0d46c9b12b88c55e18f249
I20260808 15:02:12.003367 18997 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db: loading cluster ID for follower catalog manager: success
I20260808 15:02:12.007321 18997 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db: acquiring CA information for follower catalog manager: success
I20260808 15:02:12.010213 18997 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 41bef734b05f4596ae6a4f85bd91a9db: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 15:02:12.063268 18905 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.047430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56280 (local address 127.12.73.190:38661)
0808 15:02:12.047626 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.047634 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.059566 (+ 11932us) server_negotiation.cc:407] Connection header received
0808 15:02:12.061238 (+ 1672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.061245 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.061340 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.061425 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.062996 (+ 1571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56280: BlockingRecv error: recv got EOF from 127.0.0.1:56280 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 15:02:12.064136 18907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.047022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37408 (local address 127.12.73.188:40531)
0808 15:02:12.047256 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.047263 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.061827 (+ 14564us) server_negotiation.cc:407] Connection header received
0808 15:02:12.062138 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.062145 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.062237 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.062317 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.063899 (+ 1582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37408: BlockingRecv error: recv got EOF from 127.0.0.1:37408 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 15:02:12.064182 18769 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.060189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60998 (local address 127.12.73.189:45397)
0808 15:02:12.060399 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.060405 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.062160 (+ 1755us) server_negotiation.cc:407] Connection header received
0808 15:02:12.062441 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.062449 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.062531 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.062608 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.063966 (+ 1358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60998: BlockingRecv error: recv got EOF from 127.0.0.1:60998 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 15:02:12.080912 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:12.071125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32780 (local address 127.12.73.189:45397)
0808 15:02:12.071298 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.071304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.073723 (+ 2419us) server_negotiation.cc:407] Connection header received
0808 15:02:12.073949 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.073955 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.074166 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.074356 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:12.074851 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.076041 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.078041 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.078710 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.078851 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:12.079460 (+ 609us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:12.080174 (+ 714us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:12.080351 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:12.080487 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 15:02:12.080575 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 15:02:12.091073 18907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.088507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37418 (local address 127.12.73.188:40531)
0808 15:02:12.088720 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.088726 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.089249 (+ 523us) server_negotiation.cc:407] Connection header received
0808 15:02:12.089529 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.089536 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.089660 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.089748 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.090840 (+ 1092us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37418: BlockingRecv error: recv got EOF from 127.0.0.1:37418 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 15:02:12.108019 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:12.099481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32790 (local address 127.12.73.189:45397)
0808 15:02:12.099697 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.099703 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.101764 (+ 2061us) server_negotiation.cc:407] Connection header received
0808 15:02:12.101910 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.101916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.102007 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.102104 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:12.102649 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.103858 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.105903 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.106582 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.106716 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:12.107194 (+ 478us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:12.107360 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:12.107455 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:12.107629 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 15:02:12.107720 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 15:02:12.121994 18907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.119627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37424 (local address 127.12.73.188:40531)
0808 15:02:12.119818 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.119824 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.120412 (+ 588us) server_negotiation.cc:407] Connection header received
0808 15:02:12.120583 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.120589 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.120699 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.120808 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.121736 (+ 928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37424: BlockingRecv error: recv got EOF from 127.0.0.1:37424 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 15:02:12.133876 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:12.126971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32802 (local address 127.12.73.189:45397)
0808 15:02:12.127147 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.127153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.127634 (+ 481us) server_negotiation.cc:407] Connection header received
0808 15:02:12.127818 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.127825 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.127917 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.128016 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:12.128449 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.129692 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.131706 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.132421 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.132563 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:12.133016 (+ 453us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:12.133149 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:12.133280 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:12.133445 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 15:02:12.133539 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 15:02:12.143023 18907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.140479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37426 (local address 127.12.73.188:40531)
0808 15:02:12.140678 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.140684 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.141468 (+ 784us) server_negotiation.cc:407] Connection header received
0808 15:02:12.141662 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.141668 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.141790 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.141906 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.142747 (+ 841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37426: BlockingRecv error: recv got EOF from 127.0.0.1:37426 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 15:02:12.189013 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:12.181596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32810 (local address 127.12.73.189:45397)
0808 15:02:12.181858 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.181865 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.182438 (+ 573us) server_negotiation.cc:407] Connection header received
0808 15:02:12.182646 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.182652 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.182756 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.182858 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:12.183490 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.184684 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.186658 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.187381 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.187514 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:12.188008 (+ 494us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:12.188209 (+ 201us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:12.188302 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:12.188531 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 15:02:12.188613 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
W20260808 15:02:12.201593 18907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.199113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37430 (local address 127.12.73.188:40531)
0808 15:02:12.199386 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.199392 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.200002 (+ 610us) server_negotiation.cc:407] Connection header received
0808 15:02:12.200182 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.200189 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.200294 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.200412 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.201365 (+ 953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37430: BlockingRecv error: recv got EOF from 127.0.0.1:37430 (error 108)
Metrics: {"server-negotiator.queue_time_us":150}
I20260808 15:02:12.222340 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:12.215301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32820 (local address 127.12.73.189:45397)
0808 15:02:12.215496 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.215502 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.215693 (+ 191us) server_negotiation.cc:407] Connection header received
0808 15:02:12.215993 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.216000 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.216098 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.216207 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:12.216711 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.217980 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.220027 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.220775 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.220922 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:12.221460 (+ 538us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:12.221624 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:12.221735 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:12.221913 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 15:02:12.222001 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 15:02:12.235437 18907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.231032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37438 (local address 127.12.73.188:40531)
0808 15:02:12.231224 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.231231 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.233814 (+ 2583us) server_negotiation.cc:407] Connection header received
0808 15:02:12.233971 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.233976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.234068 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.234169 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.235141 (+ 972us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37438: BlockingRecv error: recv got EOF from 127.0.0.1:37438 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 15:02:12.262764 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:12.254995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32834 (local address 127.12.73.189:45397)
0808 15:02:12.255202 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.255208 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.255816 (+ 608us) server_negotiation.cc:407] Connection header received
0808 15:02:12.256063 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.256069 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.256165 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.256278 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:12.256828 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.258179 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.260252 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.260976 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.261196 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:12.261949 (+ 753us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:12.262116 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:12.262293 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:12.262380 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 15:02:12.262468 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 15:02:12.271939 18907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.269627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37452 (local address 127.12.73.188:40531)
0808 15:02:12.269832 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.269838 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.270390 (+ 552us) server_negotiation.cc:407] Connection header received
0808 15:02:12.270535 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.270540 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.270648 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.270758 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.271685 (+ 927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37452: BlockingRecv error: recv got EOF from 127.0.0.1:37452 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 15:02:12.318811 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:12.311119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32836 (local address 127.12.73.189:45397)
0808 15:02:12.311367 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.311376 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.312006 (+ 630us) server_negotiation.cc:407] Connection header received
0808 15:02:12.312244 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.312251 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.312342 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.312456 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:12.313062 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.314286 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.316373 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.317148 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.317314 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:12.317840 (+ 526us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:12.317987 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:12.318080 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:12.318290 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 15:02:12.318385 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 15:02:12.330199 18907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.327344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37456 (local address 127.12.73.188:40531)
0808 15:02:12.327554 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.327560 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.328505 (+ 945us) server_negotiation.cc:407] Connection header received
0808 15:02:12.328718 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.328724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.328832 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.328950 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.329933 (+ 983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37456: BlockingRecv error: recv got EOF from 127.0.0.1:37456 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 15:02:12.405246 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:12.398697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47150 (local address 127.12.73.189:45397)
0808 15:02:12.398962 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.398972 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.399499 (+ 527us) server_negotiation.cc:407] Connection header received
0808 15:02:12.399741 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.399753 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.399855 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.399980 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:12.400436 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.401695 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.403019 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.403765 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.403912 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:12.404423 (+ 511us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:12.404561 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:12.404671 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:12.404824 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 15:02:12.404913 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 15:02:12.414158 18907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.412136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37568 (local address 127.12.73.188:40531)
0808 15:02:12.412346 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.412352 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.412719 (+ 367us) server_negotiation.cc:407] Connection header received
0808 15:02:12.412890 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.412895 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.412998 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.413117 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.413932 (+ 815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37568: BlockingRecv error: recv got EOF from 127.0.0.1:37568 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 15:02:12.509480 18913 sys_catalog.cc:455] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a219b0f2e1d741b4b9752979809abd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a219b0f2e1d741b4b9752979809abd7e" member_type: VOTER last_known_addr { host: "127.12.73.190" port: 38661 } } peers { permanent_uuid: "41bef734b05f4596ae6a4f85bd91a9db" member_type: VOTER last_known_addr { host: "127.12.73.189" port: 45397 } } peers { permanent_uuid: "216b11082ef94435893461c109c96138" member_type: VOTER last_known_addr { host: "127.12.73.188" port: 40531 } } }
I20260808 15:02:12.509902 18913 sys_catalog.cc:458] T 00000000000000000000000000000000 P a219b0f2e1d741b4b9752979809abd7e [sys.catalog]: This master's current role is: LEADER
I20260808 15:02:12.552898 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:12.546761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47154 (local address 127.12.73.189:45397)
0808 15:02:12.546995 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.547001 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.547399 (+ 398us) server_negotiation.cc:407] Connection header received
0808 15:02:12.547620 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.547624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.547696 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.547779 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:12.548347 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.549489 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.551046 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.551503 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.551654 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:12.552070 (+ 416us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:12.552184 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:12.552290 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:12.552450 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 15:02:12.552535 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260808 15:02:12.561478 18907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.559119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37580 (local address 127.12.73.188:40531)
0808 15:02:12.559348 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.559354 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.559770 (+ 416us) server_negotiation.cc:407] Connection header received
0808 15:02:12.559980 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.559984 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.560058 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.560135 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.561215 (+ 1080us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37580: BlockingRecv error: recv got EOF from 127.0.0.1:37580 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 15:02:12.828087 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:12.823055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47168 (local address 127.12.73.189:45397)
0808 15:02:12.823364 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.823369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.823554 (+ 185us) server_negotiation.cc:407] Connection header received
0808 15:02:12.823747 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.823752 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.823822 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.823933 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:12.824298 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.825007 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.826388 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:12.826789 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:12.826878 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:12.827348 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:12.827443 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:12.827508 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:12.827701 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 15:02:12.827765 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182}
I20260808 15:02:12.832135 18958 catalog_manager.cc:1259] Loaded cluster ID: ae9a57ad8a0d46c9b12b88c55e18f249
I20260808 15:02:12.832345 18958 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138: loading cluster ID for follower catalog manager: success
I20260808 15:02:12.836673 18958 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138: acquiring CA information for follower catalog manager: success
W20260808 15:02:12.838747 18907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 15:02:12.835991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37584 (local address 127.12.73.188:40531)
0808 15:02:12.836240 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:12.836249 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:12.836820 (+ 571us) server_negotiation.cc:407] Connection header received
0808 15:02:12.837094 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:12.837100 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:12.837252 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:12.837642 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0808 15:02:12.838488 (+ 846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37584: BlockingRecv error: recv got EOF from 127.0.0.1:37584 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 15:02:12.839706 18958 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 216b11082ef94435893461c109c96138: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 15:02:13.359959 19189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:13.354552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47180 (local address 127.12.73.189:45397)
0808 15:02:13.355050 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:13.355055 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:13.355160 (+ 105us) server_negotiation.cc:407] Connection header received
0808 15:02:13.355327 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:13.355331 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:13.355407 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:13.355506 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:13.355954 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:13.356705 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:13.358332 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:13.358760 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:13.358866 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:13.359346 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:13.359449 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:13.359517 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:13.359664 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 15:02:13.359729 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":285,"threads_started":1}
I20260808 15:02:13.371183 19200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:13.365828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37588 (local address 127.12.73.188:40531)
0808 15:02:13.366314 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:13.366319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:13.366405 (+ 86us) server_negotiation.cc:407] Connection header received
0808 15:02:13.366543 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:13.366547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:13.366695 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:13.366799 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:13.367148 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:13.367815 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:13.369126 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:13.369605 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:13.369700 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:13.370164 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:13.370682 (+ 518us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:13.370789 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:13.370919 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 15:02:13.370979 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":252,"threads_started":1}
I20260808 15:02:13.385367 19189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:13.378068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47190 (local address 127.12.73.189:45397)
0808 15:02:13.378252 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:13.378259 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:13.378613 (+ 354us) server_negotiation.cc:407] Connection header received
0808 15:02:13.378941 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:13.378946 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:13.379040 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:13.379092 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:13.379913 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:13.380842 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:13.383108 (+ 2266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:13.383755 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:13.383877 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:13.384491 (+ 614us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:13.384639 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:13.384730 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:13.384949 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 15:02:13.385039 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 15:02:13.385933 19200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:13.377388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37590 (local address 127.12.73.188:40531)
0808 15:02:13.378464 (+ 1076us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:13.378472 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:13.379241 (+ 769us) server_negotiation.cc:407] Connection header received
0808 15:02:13.379414 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:13.379420 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:13.379531 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:13.379631 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:13.380621 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:13.381718 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:13.383900 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:13.384407 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:13.384530 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:13.385048 (+ 518us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:13.385214 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:13.385279 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:13.385507 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 15:02:13.385583 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":924}
I20260808 15:02:13.386740 19211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 15:02:13.377196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36134 (local address 127.12.73.190:38661)
0808 15:02:13.378868 (+ 1672us) server_negotiation.cc:206] Beginning negotiation
0808 15:02:13.378877 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 15:02:13.378899 (+ 22us) server_negotiation.cc:407] Connection header received
0808 15:02:13.379018 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 15:02:13.379024 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 15:02:13.379251 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 15:02:13.379432 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 15:02:13.380071 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:13.381194 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:13.383489 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 15:02:13.384124 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 15:02:13.384268 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 15:02:13.384855 (+ 587us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 15:02:13.385364 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 15:02:13.385506 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 15:02:13.386319 (+ 813us) server_negotiation.cc:299] Negotiation successful
0808 15:02:13.386424 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1508,"thread_start_us":1397,"threads_started":1}
I20260808 15:02:13.390920 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 18536
I20260808 15:02:13.392038 18634 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:02:13.503932 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 18536
W20260808 15:02:13.533857 18812 connection.cc:535] server connection from 127.0.0.1:37376 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 15:02:13.534523 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 18660
I20260808 15:02:13.535647 18758 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:02:13.643729 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 18660
I20260808 15:02:13.678171 12582 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu pid 18776
I20260808 15:02:13.679634 18888 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 15:02:13.793027 12582 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktuKHj1/build/asan/bin/kudu with pid 18776
2026-08-08T15:02:13Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5428 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10519 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (380881 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST